LinkedServiceAzureDatabricks is the Schema for the LinkedServiceAzureDatabrickss API. Manages a Linked Service (connection) between Azure Databricks and Azure Data Factory.
Type
CRD
Group
datafactory.azure.upbound.io
Version
v1beta1
apiVersion: datafactory.azure.upbound.io/v1beta1
kind: LinkedServiceAzureDatabricks
LinkedServiceAzureDatabricksSpec defines the desired state of LinkedServiceAzureDatabricks
No description provided.
List of tags that can be used for describing the Data Factory Linked Service.
Reference to a Factory in datafactory to populate dataFactoryId.
Policies for referencing.
Selector for a Factory in datafactory to populate dataFactoryId.
Policies for selection.
Leverages an instance pool within the linked ADB instance as defined by instance_pool block below.
Authenticate to ADB via Azure Key Vault Linked Service as defined in the key_vault_password block below.
Reference to a Workspace in databricks to populate msiWorkSpaceResourceId.
Policies for referencing.
Selector for a Workspace in databricks to populate msiWorkSpaceResourceId.
Policies for selection.
Creates new clusters within the linked ADB instance as defined in the new_cluster_config block below.
User defined initialization scripts for the cluster.
ProviderConfigReference specifies how the provider that will be used to create, observe, update, and delete this managed resource should be configured.
Policies for referencing.
ProviderReference specifies the provider that will be used to create, observe, update, and delete this managed resource. Deprecated: Please use ProviderConfigReference, i.e. providerConfigRef
Policies for referencing.
PublishConnectionDetailsTo specifies the connection secret config which contains a name, metadata and a reference to secret store config to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource.
WriteConnectionSecretToReference specifies the namespace and name of a Secret to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource. This field is planned to be replaced in a future release in favor of PublishConnectionDetailsTo. Currently, both could be set independently and connection details would be published to both without affecting each other.
LinkedServiceAzureDatabricksStatus defines the observed state of LinkedServiceAzureDatabricks.
No description provided.
Conditions of the resource.
example
apiVersion: datafactory.azure.upbound.io/v1beta1
kind: LinkedServiceAzureDatabricks
metadata:
annotations:
meta.upbound.io/example-id: datafactory/v1beta1/linkedserviceazuredatabricks
labels:
testing.upbound.io/example-name: example
name: example
spec:
forProvider:
accessTokenSecretRef:
key: example-key
name: example-name
namespace: upbound-system
adbDomain: https://example.com
dataFactoryIdSelector:
matchLabels:
testing.upbound.io/example-name: azuredatabricks-factory
description: ADB Linked Service via MSI
newClusterConfig:
- clusterVersion: 5.5.x-gpu-scala2.11
customTags:
custom_tag1: sct_value_1
custom_tag2: sct_value_2
driverNodeType: Standard_NC12
initScripts:
- init.sh
- init2.sh
logDestination: dbfs:/logs
maxNumberOfWorkers: 5
minNumberOfWorkers: 1
nodeType: Standard_NC12
sparkConfig:
config1: value1
config2: value2
sparkEnvironmentVariables:
envVar1: value1
envVar2: value2
© 2022 Upbound, Inc.
Discover the building blocksfor your internal cloud platform.