LinkedServiceAzureDatabricks is the Schema for the LinkedServiceAzureDatabrickss API. Manages a Linked Service (connection) between Azure Databricks and Azure Data Factory.
Type
CRD
Group
datafactory.azure.upbound.io
Version
v1beta1
apiVersion: datafactory.azure.upbound.io/v1beta1
kind: LinkedServiceAzureDatabricks
LinkedServiceAzureDatabricksSpec defines the desired state of LinkedServiceAzureDatabricks
No description provided.
List of tags that can be used for describing the Data Factory Linked Service.
Reference to a Factory in datafactory to populate dataFactoryId.
Policies for referencing.
Selector for a Factory in datafactory to populate dataFactoryId.
Policies for selection.
Leverages an instance pool within the linked ADB instance as defined by instance_pool block below.
Authenticate to ADB via Azure Key Vault Linked Service as defined in the key_vault_password block below.
Reference to a Workspace in databricks to populate msiWorkSpaceResourceId.
Policies for referencing.
Selector for a Workspace in databricks to populate msiWorkSpaceResourceId.
Policies for selection.
Creates new clusters within the linked ADB instance as defined in the new_cluster_config block below.
User defined initialization scripts for the cluster.
THIS IS AN ALPHA FIELD. Do not use it in production. It is not honored unless the relevant Crossplane feature flag is enabled, and may be changed or removed without notice. InitProvider holds the same fields as ForProvider, with the exception of Identifier and other resource reference fields. The fields that are in InitProvider are merged into ForProvider when the resource is created. The same fields are also added to the terraform ignore_changes hook, to avoid updating them after creation. This is useful for fields that are required on creation, but we do not desire to update them after creation, for example because of an external controller is managing them, like an autoscaler.
List of tags that can be used for describing the Data Factory Linked Service.
Leverages an instance pool within the linked ADB instance as defined by instance_pool block below.
Authenticate to ADB via Azure Key Vault Linked Service as defined in the key_vault_password block below.
Creates new clusters within the linked ADB instance as defined in the new_cluster_config block below.
User defined initialization scripts for the cluster.
THIS IS AN ALPHA FIELD. Do not use it in production. It is not honored unless the relevant Crossplane feature flag is enabled, and may be changed or removed without notice. ManagementPolicies specify the array of actions Crossplane is allowed to take on the managed and external resources. This field is planned to replace the DeletionPolicy field in a future release. Currently, both could be set independently and non-default values would be honored if the feature flag is enabled. If both are custom, the DeletionPolicy field will be ignored. See the design doc for more information: https://github.com/crossplane/crossplane/blob/499895a25d1a1a0ba1604944ef98ac7a1a71f197/design/design-doc-observe-only-resources.md?plain=1#L223 and this one: https://github.com/crossplane/crossplane/blob/444267e84783136daa93568b364a5f01228cacbe/design/one-pager-ignore-changes.md
ProviderConfigReference specifies how the provider that will be used to create, observe, update, and delete this managed resource should be configured.
Policies for referencing.
ProviderReference specifies the provider that will be used to create, observe, update, and delete this managed resource. Deprecated: Please use ProviderConfigReference, i.e. providerConfigRef
Policies for referencing.
PublishConnectionDetailsTo specifies the connection secret config which contains a name, metadata and a reference to secret store config to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource.
WriteConnectionSecretToReference specifies the namespace and name of a Secret to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource. This field is planned to be replaced in a future release in favor of PublishConnectionDetailsTo. Currently, both could be set independently and connection details would be published to both without affecting each other.
LinkedServiceAzureDatabricksStatus defines the observed state of LinkedServiceAzureDatabricks.
No description provided.
List of tags that can be used for describing the Data Factory Linked Service.
Leverages an instance pool within the linked ADB instance as defined by instance_pool block below.
Authenticate to ADB via Azure Key Vault Linked Service as defined in the key_vault_password block below.
Creates new clusters within the linked ADB instance as defined in the new_cluster_config block below.
User defined initialization scripts for the cluster.
Conditions of the resource.
example
apiVersion: datafactory.azure.upbound.io/v1beta1
kind: LinkedServiceAzureDatabricks
metadata:
annotations:
meta.upbound.io/example-id: datafactory/v1beta1/linkedserviceazuredatabricks
labels:
testing.upbound.io/example-name: example
name: example
spec:
forProvider:
accessTokenSecretRef:
key: example-key
name: example-name
namespace: upbound-system
adbDomain: https://example.com
dataFactoryIdSelector:
matchLabels:
testing.upbound.io/example-name: azuredatabricks-factory
description: ADB Linked Service via MSI
newClusterConfig:
- clusterVersion: 5.5.x-gpu-scala2.11
customTags:
custom_tag1: sct_value_1
custom_tag2: sct_value_2
driverNodeType: Standard_NC12
initScripts:
- init.sh
- init2.sh
logDestination: dbfs:/logs
maxNumberOfWorkers: 5
minNumberOfWorkers: 1
nodeType: Standard_NC12
sparkConfig:
config1: value1
config2: value2
sparkEnvironmentVariables:
envVar1: value1
envVar2: value2
© 2022 Upbound, Inc.
Discover the building blocksfor your internal cloud platform.