Job - upbound/provider-databricks@v0.1.7

(List) An optional set of email addresses notified when runs of this job begins, completes or fails. The default behavior is to not send any emails. This field is a block and is documented below.

noAlertForSkippedRuns

boolean

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

onStreamingBacklogExceeded

array

(No description available)

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

environment

array

(No description available)

environmentKey

string

spec

object

block describing the Environment. Consists of following attributes:

client

string

dependencies

array

(list of strings) List of pip dependencies, as supported by the version of pip in this environment. Each dependency is a pip requirement file line. See API docs for more information.

existingClusterId

string

format

string

gitSource

object

Specifices the a Git repository for task source code. See git_source Configuration Block below.

branch

string

commit

string

gitSnapshot

object

(No description available)

usedCommit

string

jobSource

object

The source of the project. Possible values are WORKSPACE and GIT. Defaults to GIT if a git_source block is present in the job definition.

string

string

string

string

string

string

object

An optional block that specifies the health conditions for the job documented below.

rules

array

(List) list of rules that are represented as objects with the following attributes:

metric

string

value

number

jobCluster

array

A list of job databricks_cluster specifications that can be shared and reused by tasks of this job. Libraries cannot be declared in a shared job cluster. You must declare dependent libraries in task settings. Multi-task syntax

jobClusterKey

string

newCluster

object

Block with almost the same set of parameters as for databricks_cluster resource, except following (check the REST API documentation for full list of supported parameters):

applyPolicyDefaultValues

boolean

autoscale

object

(No description available)

maxWorkers

number

minWorkers

number

awsAttributes

object

(No description available)

string

number

number

number

number

string

number

string

number

string

object

(No description available)

availability

string

firstOnDemand

number

logAnalyticsInfo

object

(No description available)

logAnalyticsPrimaryKey

string

logAnalyticsWorkspaceId

string

spotBidMaxPrice

number

clusterId

string

clusterLogConf

object

(No description available)

dbfs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

array

(No description available)

localMountDirPath

string

networkFilesystemInfo

object

(No description available)

string

string

string

string

object

string

object

(No description available)

basicAuth

object

(No description available)

passwordSecretRef

object

A LocalSecretKeySelector is a reference to a secret key in the same namespace with the referencing object.

key

required

string

name

required

string

string

string

string

string

boolean

enableLocalDiskEncryption

boolean

gcpAttributes

object

(No description available)

string

number

string

number

usePreemptibleExecutors

boolean

zoneId

string

idempotencyToken

string

initScripts

array

(No description available)

abfss

object

(No description available)

destination

string

dbfs

object

(No description available)

destination

string

file

object

block consisting of single string fields:

destination

string

gcs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

object

(No description available)

destination

string

workspace

object

(No description available)

string

string

boolean

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

string

number

string

string

string

object

object

string

array

(No description available)

useMlRuntime

boolean

workloadType

object

isn't supported

clients

object

(No description available)

jobs

boolean

notebooks

boolean

library

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

number

number

minRetryIntervalMillis

number

name

string

newCluster

object

Task will run on a dedicated cluster. See databricks_cluster documentation for specification. Some parameters, such as

applyPolicyDefaultValues

boolean

autoscale

object

(No description available)

maxWorkers

number

minWorkers

number

awsAttributes

object

(No description available)

string

number

number

number

number

string

number

string

number

string

object

(No description available)

availability

string

firstOnDemand

number

logAnalyticsInfo

object

(No description available)

logAnalyticsPrimaryKey

string

logAnalyticsWorkspaceId

string

spotBidMaxPrice

number

clusterId

string

clusterLogConf

object

(No description available)

dbfs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

array

(No description available)

localMountDirPath

string

networkFilesystemInfo

object

(No description available)

string

string

string

string

object

string

object

(No description available)

basicAuth

object

(No description available)

passwordSecretRef

object

A LocalSecretKeySelector is a reference to a secret key in the same namespace with the referencing object.

key

required

string

name

required

string

string

string

string

string

boolean

enableLocalDiskEncryption

boolean

gcpAttributes

object

(No description available)

string

number

string

number

usePreemptibleExecutors

boolean

zoneId

string

idempotencyToken

string

initScripts

array

(No description available)

abfss

object

(No description available)

destination

string

dbfs

object

(No description available)

destination

string

file

object

block consisting of single string fields:

destination

string

gcs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

object

(No description available)

destination

string

workspace

object

(No description available)

string

string

boolean

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

string

number

string

string

string

object

object

string

array

(No description available)

useMlRuntime

boolean

workloadType

object

isn't supported

clients

object

(No description available)

jobs

boolean

notebooks

boolean

notebookTask

object

A list of task specification that the job will execute. See task Configuration Block below.

object

string

string

string

object

An optional block controlling the notification settings on the job level documented below.

noAlertForCanceledRuns

boolean

noAlertForSkippedRuns

boolean

parameter

array

Specifices job parameter for the job. See parameter Configuration Block

default

string

name

string

pipelineTask

object

A list of task specification that the job will execute. See task Configuration Block below.

fullRefresh

boolean

pipelineId

string

pythonWheelTask

object

A list of task specification that the job will execute. See task Configuration Block below.

string

object

string

array

Parameters for the task

queue

object

The queue status for the job. See queue Configuration Block below.

enabled

boolean

retryOnTimeout

boolean

runAs

object

The user or the service prinicipal the job runs as. See run_as Configuration Block below.

servicePrincipalName

string

userName

string

runJobTask

object

A list of task specification that the job will execute. See task Configuration Block below.

jobId

number

jobParameters

object

schedule

object

An optional periodic schedule for this job. The default behavior is that the job runs when triggered by clicking Run Now in the Jobs UI or sending an API request to runNow. See schedule Configuration Block below.

string

string

string

object

A list of task specification that the job will execute. See task Configuration Block below.

jarUri

string

mainClassName

string

parameters

array

Parameters for the task

sparkPythonTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

pythonFile

string

source

string

sparkSubmitTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

tags

object

task

array

A list of task specification that the job will execute. See task Configuration Block below.

cleanRoomsNotebookTask

object

A list of task specification that the job will execute. See task Configuration Block below.

cleanRoomName

string

etag

string

notebookBaseParameters

object

notebookName

string

conditionTask

object

A list of task specification that the job will execute. See task Configuration Block below.

left

string

right

string

dbtTask

object

A list of task specification that the job will execute. See task Configuration Block below.

catalog

string

commands

array

(Array) Series of dbt commands to execute in sequence. Every command must start with "dbt".

string

string

string

string

string

array

block specifying dependency(-ies) for a given task.

outcome

string

taskKey

string

description

string

disableAutoOptimization

boolean

emailNotifications

object

(List) An optional set of email addresses notified when runs of this job begins, completes or fails. The default behavior is to not send any emails. This field is a block and is documented below.

noAlertForSkippedRuns

boolean

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

onStreamingBacklogExceeded

array

(No description available)

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

environmentKey

string

existingClusterId

string

existingClusterIdRef

object

Reference to a Cluster in compute to populate existingClusterId.

name

required

string

namespace

string

policy

object

Policies for referencing.

resolution

string

resolve

string

existingClusterIdSelector

object

Selector for a Cluster in compute to populate existingClusterId.

boolean

object

string

object

Policies for selection.

resolution

string

resolve

string

forEachTask

object

A list of task specification that the job will execute. See task Configuration Block below.

concurrency

number

inputs

string

task

object

A list of task specification that the job will execute. See task Configuration Block below.

cleanRoomsNotebookTask

object

A list of task specification that the job will execute. See task Configuration Block below.

cleanRoomName

string

etag

string

notebookBaseParameters

object

notebookName

string

conditionTask

object

A list of task specification that the job will execute. See task Configuration Block below.

left

string

right

string

dbtTask

object

A list of task specification that the job will execute. See task Configuration Block below.

catalog

string

commands

array

(Array) Series of dbt commands to execute in sequence. Every command must start with "dbt".

string

string

string

string

string

array

block specifying dependency(-ies) for a given task.

outcome

string

taskKey

string

description

string

disableAutoOptimization

boolean

emailNotifications

object

(List) An optional set of email addresses notified when runs of this job begins, completes or fails. The default behavior is to not send any emails. This field is a block and is documented below.

noAlertForSkippedRuns

boolean

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

onStreamingBacklogExceeded

array

(No description available)

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

environmentKey

string

existingClusterId

string

health

object

An optional block that specifies the health conditions for the job documented below.

rules

array

(List) list of rules that are represented as objects with the following attributes:

string

number

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

number

minRetryIntervalMillis

number

newCluster

object

Task will run on a dedicated cluster. See databricks_cluster documentation for specification. Some parameters, such as

applyPolicyDefaultValues

boolean

autoscale

object

(No description available)

maxWorkers

number

minWorkers

number

awsAttributes

object

(No description available)

string

number

number

number

number

string

number

string

number

string

object

(No description available)

availability

string

firstOnDemand

number

logAnalyticsInfo

object

(No description available)

logAnalyticsPrimaryKey

string

logAnalyticsWorkspaceId

string

spotBidMaxPrice

number

clusterId

string

clusterLogConf

object

(No description available)

dbfs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

array

(No description available)

localMountDirPath

string

networkFilesystemInfo

object

(No description available)

string

string

string

string

object

string

object

(No description available)

basicAuth

object

(No description available)

passwordSecretRef

object

A LocalSecretKeySelector is a reference to a secret key in the same namespace with the referencing object.

key

required

string

name

required

string

string

string

string

string

boolean

enableLocalDiskEncryption

boolean

gcpAttributes

object

(No description available)

string

number

string

number

usePreemptibleExecutors

boolean

zoneId

string

idempotencyToken

string

initScripts

array

(No description available)

abfss

object

(No description available)

destination

string

dbfs

object

(No description available)

destination

string

file

object

block consisting of single string fields:

destination

string

gcs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

object

(No description available)

destination

string

workspace

object

(No description available)

string

string

boolean

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

string

number

string

string

string

object

object

string

array

(No description available)

useMlRuntime

boolean

workloadType

object

isn't supported

clients

object

(No description available)

jobs

boolean

notebooks

boolean

notebookTask

object

A list of task specification that the job will execute. See task Configuration Block below.

object

string

string

string

object

An optional block controlling the notification settings on the job level documented below.

alertOnLastAttempt

boolean

noAlertForCanceledRuns

boolean

noAlertForSkippedRuns

boolean

pipelineTask

object

A list of task specification that the job will execute. See task Configuration Block below.

fullRefresh

boolean

pipelineId

string

pythonWheelTask

object

A list of task specification that the job will execute. See task Configuration Block below.

string

object

string

array

Parameters for the task

retryOnTimeout

boolean

runIf

string

runJobTask

object

A list of task specification that the job will execute. See task Configuration Block below.

dbtCommands

array

(Array) Series of dbt commands to execute in sequence. Every command must start with "dbt".

jarParams

array

(No description available)

number

object

object

object

(No description available)

fullRefresh

boolean

pythonNamedParams

object

pythonParams

array

(No description available)

sparkSubmitParams

array

(No description available)

sqlParams

object

sparkJarTask

object

A list of task specification that the job will execute. See task Configuration Block below.

jarUri

string

mainClassName

string

parameters

array

Parameters for the task

runAsRepl

boolean

sparkPythonTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

pythonFile

string

source

string

sparkSubmitTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

sqlTask

object

A list of task specification that the job will execute. See task Configuration Block below.

alert

object

block consisting of following fields:

alertId

string

pauseSubscriptions

boolean

subscriptions

array

a list of subscription blocks consisting out of one of the required fields: user_name for user emails or destination_id - for Alert destination's identifier.

destinationId

string

userName

string

dashboard

object

block consisting of following fields:

string

string

boolean

array

a list of subscription blocks consisting out of one of the required fields: user_name for user emails or destination_id - for Alert destination's identifier.

destinationId

string

userName

string

file

object

block consisting of single string fields:

string

string

object

object

block consisting of single string field: query_id - identifier of the Databricks Query (databricks_query).

string

string

string

number

object

(List) An optional set of system destinations (for example, webhook destinations or Slack) to be notified when runs of this job begins, completes or fails. The default behavior is to not send any notifications. This field is a block and is documented below.

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

string

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

string

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

string

onStreamingBacklogExceeded

array

(No description available)

string

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

string

health

object

An optional block that specifies the health conditions for the job documented below.

rules

array

(List) list of rules that are represented as objects with the following attributes:

string

number

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

number

minRetryIntervalMillis

number

newCluster

object

Task will run on a dedicated cluster. See databricks_cluster documentation for specification. Some parameters, such as

applyPolicyDefaultValues

boolean

autoscale

object

(No description available)

maxWorkers

number

minWorkers

number

awsAttributes

object

(No description available)

string

number

number

number

number

string

number

string

number

string

object

(No description available)

availability

string

firstOnDemand

number

logAnalyticsInfo

object

(No description available)

logAnalyticsPrimaryKey

string

logAnalyticsWorkspaceId

string

spotBidMaxPrice

number

clusterId

string

clusterLogConf

object

(No description available)

dbfs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

array

(No description available)

localMountDirPath

string

networkFilesystemInfo

object

(No description available)

string

string

string

string

object

string

object

(No description available)

basicAuth

object

(No description available)

passwordSecretRef

object

A LocalSecretKeySelector is a reference to a secret key in the same namespace with the referencing object.

key

required

string

name

required

string

string

string

string

string

boolean

enableLocalDiskEncryption

boolean

gcpAttributes

object

(No description available)

string

number

string

number

usePreemptibleExecutors

boolean

zoneId

string

idempotencyToken

string

initScripts

array

(No description available)

abfss

object

(No description available)

destination

string

dbfs

object

(No description available)

destination

string

file

object

block consisting of single string fields:

destination

string

gcs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

object

(No description available)

destination

string

workspace

object

(No description available)

string

string

boolean

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

string

number

string

string

string

object

object

string

array

(No description available)

useMlRuntime

boolean

workloadType

object

isn't supported

clients

object

(No description available)

jobs

boolean

notebooks

boolean

notebookTask

object

A list of task specification that the job will execute. See task Configuration Block below.

baseParameters

object

notebookPath

string

notebookPathRef

object

Reference to a Notebook in workspace to populate notebookPath.

name

required

string

namespace

string

policy

object

Policies for referencing.

resolution

string

resolve

string

notebookPathSelector

object

Selector for a Notebook in workspace to populate notebookPath.

boolean

object

string

object

Policies for selection.

string

string

string

string

object

An optional block controlling the notification settings on the job level documented below.

alertOnLastAttempt

boolean

noAlertForCanceledRuns

boolean

noAlertForSkippedRuns

boolean

pipelineTask

object

A list of task specification that the job will execute. See task Configuration Block below.

fullRefresh

boolean

pipelineId

string

pipelineIdRef

object

Reference to a Pipeline in compute to populate pipelineId.

name

required

string

namespace

string

policy

object

Policies for referencing.

resolution

string

resolve

string

pipelineIdSelector

object

Selector for a Pipeline in compute to populate pipelineId.

boolean

object

string

object

Policies for selection.

resolution

string

resolve

string

pythonWheelTask

object

A list of task specification that the job will execute. See task Configuration Block below.

string

object

string

array

Parameters for the task

retryOnTimeout

boolean

runIf

string

runJobTask

object

A list of task specification that the job will execute. See task Configuration Block below.

dbtCommands

array

(Array) Series of dbt commands to execute in sequence. Every command must start with "dbt".

jarParams

array

(No description available)

number

object

object

object

(No description available)

fullRefresh

boolean

pythonNamedParams

object

pythonParams

array

(No description available)

sparkSubmitParams

array

(No description available)

sqlParams

object

sparkJarTask

object

A list of task specification that the job will execute. See task Configuration Block below.

jarUri

string

mainClassName

string

parameters

array

Parameters for the task

runAsRepl

boolean

sparkPythonTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

pythonFile

string

source

string

sparkSubmitTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

sqlTask

object

A list of task specification that the job will execute. See task Configuration Block below.

alert

object

block consisting of following fields:

alertId

string

pauseSubscriptions

boolean

subscriptions

array

a list of subscription blocks consisting out of one of the required fields: user_name for user emails or destination_id - for Alert destination's identifier.

destinationId

string

userName

string

dashboard

object

block consisting of following fields:

string

string

boolean

array

a list of subscription blocks consisting out of one of the required fields: user_name for user emails or destination_id - for Alert destination's identifier.

destinationId

string

userName

string

file

object

block consisting of single string fields:

string

string

object

object

block consisting of single string field: query_id - identifier of the Databricks Query (databricks_query).

string

string

string

number

object

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

string

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

string

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

string

onStreamingBacklogExceeded

array

(No description available)

string

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

string

timeoutSeconds

number

trigger

object

The conditions that triggers the job to start. See trigger Configuration Block below.

fileArrival

object

configuration block to define a trigger for File Arrival events consisting of following attributes:

minTimeBetweenTriggersSeconds

number

url

string

waitAfterLastChangeSeconds

number

pauseStatus

string

periodic

object

configuration block to define a trigger for Periodic Triggers consisting of the following attributes:

interval

number

unit

string

table

object

(No description available)

condition

string

minTimeBetweenTriggersSeconds

number

tableNames

array

(No description available)

waitAfterLastChangeSeconds

number

tableUpdate

object

(No description available)

condition

string

minTimeBetweenTriggersSeconds

number

tableNames

array

(No description available)

waitAfterLastChangeSeconds

number

webhookNotifications

object

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

string

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

string

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

string

onStreamingBacklogExceeded

array

(No description available)

string

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

string

initProvider

object

THIS IS A BETA FIELD. It will be honored unless the Management Policies feature flag is disabled. InitProvider holds the same fields as ForProvider, with the exception of Identifier and other resource reference fields. The fields that are in InitProvider are merged into ForProvider when the resource is created. The same fields are also added to the terraform ignore_changes hook, to avoid updating them after creation. This is useful for fields that are required on creation, but we do not desire to update them after creation, for example because of an external controller is managing them, like an autoscaler.

alwaysRunning

boolean

budgetPolicyId

string

continuous

object

Configuration block to configure pause status. See continuous Configuration Block.

pauseStatus

string

controlRunState

boolean

dbtTask

object

A list of task specification that the job will execute. See task Configuration Block below.

catalog

string

commands

array

(Array) Series of dbt commands to execute in sequence. Every command must start with "dbt".

string

string

string

string

string

object

(No description available)

string

string

string

string

object

(List) An optional set of email addresses notified when runs of this job begins, completes or fails. The default behavior is to not send any emails. This field is a block and is documented below.

noAlertForSkippedRuns

boolean

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

onStreamingBacklogExceeded

array

(No description available)

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

environment

array

(No description available)

environmentKey

string

spec

object

block describing the Environment. Consists of following attributes:

client

string

dependencies

array

(list of strings) List of pip dependencies, as supported by the version of pip in this environment. Each dependency is a pip requirement file line. See API docs for more information.

existingClusterId

string

format

string

gitSource

object

Specifices the a Git repository for task source code. See git_source Configuration Block below.

branch

string

commit

string

gitSnapshot

object

(No description available)

usedCommit

string

jobSource

object

The source of the project. Possible values are WORKSPACE and GIT. Defaults to GIT if a git_source block is present in the job definition.

string

string

string

string

string

string

object

An optional block that specifies the health conditions for the job documented below.

rules

array

(List) list of rules that are represented as objects with the following attributes:

string

number

array

string

object

Block with almost the same set of parameters as for databricks_cluster resource, except following (check the REST API documentation for full list of supported parameters):

applyPolicyDefaultValues

boolean

autoscale

object

(No description available)

maxWorkers

number

minWorkers

number

awsAttributes

object

(No description available)

string

number

number

number

number

string

number

string

number

string

object

(No description available)

availability

string

firstOnDemand

number

logAnalyticsInfo

object

(No description available)

logAnalyticsPrimaryKey

string

logAnalyticsWorkspaceId

string

spotBidMaxPrice

number

clusterId

string

clusterLogConf

object

(No description available)

dbfs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

array

(No description available)

localMountDirPath

string

networkFilesystemInfo

object

(No description available)

string

string

string

string

object

string

object

(No description available)

basicAuth

object

(No description available)

passwordSecretRef

required

object

required

object

A LocalSecretKeySelector is a reference to a secret key in the same namespace with the referencing object.

key

required

string

name

required

string

string

string

string

string

boolean

enableLocalDiskEncryption

boolean

gcpAttributes

object

(No description available)

string

number

string

number

usePreemptibleExecutors

boolean

zoneId

string

idempotencyToken

string

initScripts

array

(No description available)

abfss

object

(No description available)

destination

string

dbfs

object

(No description available)

destination

string

file

object

block consisting of single string fields:

destination

string

gcs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

object

(No description available)

destination

string

workspace

object

(No description available)

string

string

boolean

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

string

number

string

string

string

object

object

string

array

(No description available)

useMlRuntime

boolean

workloadType

object

isn't supported

clients

object

(No description available)

jobs

boolean

notebooks

boolean

library

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

number

number

minRetryIntervalMillis

number

name

string

newCluster

object

Task will run on a dedicated cluster. See databricks_cluster documentation for specification. Some parameters, such as

applyPolicyDefaultValues

boolean

autoscale

object

(No description available)

maxWorkers

number

minWorkers

number

awsAttributes

object

(No description available)

string

number

number

number

number

string

number

string

number

string

object

(No description available)

availability

string

firstOnDemand

number

logAnalyticsInfo

object

(No description available)

logAnalyticsPrimaryKey

string

logAnalyticsWorkspaceId

string

spotBidMaxPrice

number

clusterId

string

clusterLogConf

object

(No description available)

dbfs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

array

(No description available)

localMountDirPath

string

networkFilesystemInfo

object

(No description available)

string

string

string

string

object

string

object

(No description available)

basicAuth

object

(No description available)

passwordSecretRef

required

object

required

object

A LocalSecretKeySelector is a reference to a secret key in the same namespace with the referencing object.

key

required

string

name

required

string

string

string

string

string

boolean

enableLocalDiskEncryption

boolean

gcpAttributes

object

(No description available)

string

number

string

number

usePreemptibleExecutors

boolean

zoneId

string

idempotencyToken

string

initScripts

array

(No description available)

abfss

object

(No description available)

destination

string

dbfs

object

(No description available)

destination

string

file

object

block consisting of single string fields:

destination

string

gcs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

object

(No description available)

destination

string

workspace

object

(No description available)

string

string

boolean

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

string

number

string

string

string

object

object

string

array

(No description available)

useMlRuntime

boolean

workloadType

object

isn't supported

clients

object

(No description available)

jobs

boolean

notebooks

boolean

notebookTask

object

A list of task specification that the job will execute. See task Configuration Block below.

object

string

string

string

object

An optional block controlling the notification settings on the job level documented below.

noAlertForCanceledRuns

boolean

noAlertForSkippedRuns

boolean

parameter

array

Specifices job parameter for the job. See parameter Configuration Block

default

string

name

string

pipelineTask

object

A list of task specification that the job will execute. See task Configuration Block below.

fullRefresh

boolean

pipelineId

string

pythonWheelTask

object

A list of task specification that the job will execute. See task Configuration Block below.

string

object

string

array

Parameters for the task

queue

object

The queue status for the job. See queue Configuration Block below.

enabled

boolean

retryOnTimeout

boolean

runAs

object

The user or the service prinicipal the job runs as. See run_as Configuration Block below.

servicePrincipalName

string

userName

string

runJobTask

object

A list of task specification that the job will execute. See task Configuration Block below.

number

object

object

string

string

string

object

A list of task specification that the job will execute. See task Configuration Block below.

jarUri

string

mainClassName

string

parameters

array

Parameters for the task

sparkPythonTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

pythonFile

string

source

string

sparkSubmitTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

tags

object

task

array

A list of task specification that the job will execute. See task Configuration Block below.

cleanRoomsNotebookTask

object

A list of task specification that the job will execute. See task Configuration Block below.

cleanRoomName

string

etag

string

notebookBaseParameters

object

notebookName

string

conditionTask

object

A list of task specification that the job will execute. See task Configuration Block below.

left

string

right

string

dbtTask

object

A list of task specification that the job will execute. See task Configuration Block below.

catalog

string

commands

array

(Array) Series of dbt commands to execute in sequence. Every command must start with "dbt".

string

string

string

string

string

array

block specifying dependency(-ies) for a given task.

outcome

string

taskKey

string

description

string

disableAutoOptimization

boolean

emailNotifications

object

(List) An optional set of email addresses notified when runs of this job begins, completes or fails. The default behavior is to not send any emails. This field is a block and is documented below.

noAlertForSkippedRuns

boolean

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

onStreamingBacklogExceeded

array

(No description available)

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

environmentKey

string

existingClusterId

string

existingClusterIdRef

object

Reference to a Cluster in compute to populate existingClusterId.

name

required

string

namespace

string

policy

object

Policies for referencing.

resolution

string

resolve

string

existingClusterIdSelector

object

Selector for a Cluster in compute to populate existingClusterId.

boolean

object

string

object

Policies for selection.

resolution

string

resolve

string

forEachTask

object

A list of task specification that the job will execute. See task Configuration Block below.

concurrency

number

inputs

string

task

object

A list of task specification that the job will execute. See task Configuration Block below.

cleanRoomsNotebookTask

object

A list of task specification that the job will execute. See task Configuration Block below.

cleanRoomName

string

etag

string

notebookBaseParameters

object

notebookName

string

conditionTask

object

A list of task specification that the job will execute. See task Configuration Block below.

left

string

right

string

dbtTask

object

A list of task specification that the job will execute. See task Configuration Block below.

catalog

string

commands

array

(Array) Series of dbt commands to execute in sequence. Every command must start with "dbt".

string

string

string

string

string

array

block specifying dependency(-ies) for a given task.

outcome

string

taskKey

string

description

string

disableAutoOptimization

boolean

emailNotifications

object

(List) An optional set of email addresses notified when runs of this job begins, completes or fails. The default behavior is to not send any emails. This field is a block and is documented below.

noAlertForSkippedRuns

boolean

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

onStreamingBacklogExceeded

array

(No description available)

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

environmentKey

string

existingClusterId

string

health

object

An optional block that specifies the health conditions for the job documented below.

rules

array

(List) list of rules that are represented as objects with the following attributes:

string

number

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

number

minRetryIntervalMillis

number

newCluster

object

Task will run on a dedicated cluster. See databricks_cluster documentation for specification. Some parameters, such as

applyPolicyDefaultValues

boolean

autoscale

object

(No description available)

maxWorkers

number

minWorkers

number

awsAttributes

object

(No description available)

string

number

number

number

number

string

number

string

number

string

object

(No description available)

availability

string

firstOnDemand

number

logAnalyticsInfo

object

(No description available)

logAnalyticsPrimaryKey

string

logAnalyticsWorkspaceId

string

spotBidMaxPrice

number

clusterId

string

clusterLogConf

object

(No description available)

dbfs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

array

(No description available)

localMountDirPath

string

networkFilesystemInfo

object

(No description available)

string

string

string

string

object

string

object

(No description available)

basicAuth

object

(No description available)

passwordSecretRef

required

object

required

object

A LocalSecretKeySelector is a reference to a secret key in the same namespace with the referencing object.

key

required

string

name

required

string

string

string

string

string

boolean

enableLocalDiskEncryption

boolean

gcpAttributes

object

(No description available)

string

number

string

number

usePreemptibleExecutors

boolean

zoneId

string

idempotencyToken

string

initScripts

array

(No description available)

abfss

object

(No description available)

destination

string

dbfs

object

(No description available)

destination

string

file

object

block consisting of single string fields:

destination

string

gcs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

object

(No description available)

destination

string

workspace

object

(No description available)

string

string

boolean

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

string

number

string

string

string

object

object

string

array

(No description available)

useMlRuntime

boolean

workloadType

object

isn't supported

clients

object

(No description available)

jobs

boolean

notebooks

boolean

notebookTask

object

A list of task specification that the job will execute. See task Configuration Block below.

object

string

string

string

object

An optional block controlling the notification settings on the job level documented below.

alertOnLastAttempt

boolean

noAlertForCanceledRuns

boolean

noAlertForSkippedRuns

boolean

pipelineTask

object

A list of task specification that the job will execute. See task Configuration Block below.

fullRefresh

boolean

pipelineId

string

pythonWheelTask

object

A list of task specification that the job will execute. See task Configuration Block below.

string

object

string

array

Parameters for the task

retryOnTimeout

boolean

runIf

string

runJobTask

object

A list of task specification that the job will execute. See task Configuration Block below.

dbtCommands

array

(Array) Series of dbt commands to execute in sequence. Every command must start with "dbt".

jarParams

array

(No description available)

number

object

object

object

(No description available)

fullRefresh

boolean

pythonNamedParams

object

pythonParams

array

(No description available)

sparkSubmitParams

array

(No description available)

sqlParams

object

sparkJarTask

object

A list of task specification that the job will execute. See task Configuration Block below.

jarUri

string

mainClassName

string

parameters

array

Parameters for the task

runAsRepl

boolean

sparkPythonTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

pythonFile

string

source

string

sparkSubmitTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

sqlTask

object

A list of task specification that the job will execute. See task Configuration Block below.

alert

object

block consisting of following fields:

alertId

string

pauseSubscriptions

boolean

subscriptions

array

a list of subscription blocks consisting out of one of the required fields: user_name for user emails or destination_id - for Alert destination's identifier.

destinationId

string

userName

string

dashboard

object

block consisting of following fields:

string

string

boolean

array

a list of subscription blocks consisting out of one of the required fields: user_name for user emails or destination_id - for Alert destination's identifier.

destinationId

string

userName

string

file

object

block consisting of single string fields:

string

string

object

object

block consisting of single string field: query_id - identifier of the Databricks Query (databricks_query).

string

string

string

number

object

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

string

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

string

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

string

onStreamingBacklogExceeded

array

(No description available)

string

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

string

health

object

An optional block that specifies the health conditions for the job documented below.

rules

array

(List) list of rules that are represented as objects with the following attributes:

string

number

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

number

minRetryIntervalMillis

number

newCluster

object

Task will run on a dedicated cluster. See databricks_cluster documentation for specification. Some parameters, such as

applyPolicyDefaultValues

boolean

autoscale

object

(No description available)

maxWorkers

number

minWorkers

number

awsAttributes

object

(No description available)

string

number

number

number

number

string

number

string

number

string

object

(No description available)

availability

string

firstOnDemand

number

logAnalyticsInfo

object

(No description available)

logAnalyticsPrimaryKey

string

logAnalyticsWorkspaceId

string

spotBidMaxPrice

number

clusterId

string

clusterLogConf

object

(No description available)

dbfs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

array

(No description available)

localMountDirPath

string

networkFilesystemInfo

object

(No description available)

string

string

string

string

object

string

object

(No description available)

basicAuth

object

(No description available)

passwordSecretRef

required

object

required

object

A LocalSecretKeySelector is a reference to a secret key in the same namespace with the referencing object.

key

required

string

name

required

string

string

string

string

string

boolean

enableLocalDiskEncryption

boolean

gcpAttributes

object

(No description available)

string

number

string

number

usePreemptibleExecutors

boolean

zoneId

string

idempotencyToken

string

initScripts

array

(No description available)

abfss

object

(No description available)

destination

string

dbfs

object

(No description available)

destination

string

file

object

block consisting of single string fields:

destination

string

gcs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

object

(No description available)

destination

string

workspace

object

(No description available)

string

string

boolean

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

string

number

string

string

string

object

object

string

array

(No description available)

useMlRuntime

boolean

workloadType

object

isn't supported

clients

object

(No description available)

jobs

boolean

notebooks

boolean

notebookTask

object

A list of task specification that the job will execute. See task Configuration Block below.

baseParameters

object

notebookPath

string

notebookPathRef

object

Reference to a Notebook in workspace to populate notebookPath.

name

required

string

namespace

string

policy

object

Policies for referencing.

resolution

string

resolve

string

notebookPathSelector

object

Selector for a Notebook in workspace to populate notebookPath.

boolean

object

string

object

Policies for selection.

string

string

string

string

object

An optional block controlling the notification settings on the job level documented below.

alertOnLastAttempt

boolean

noAlertForCanceledRuns

boolean

noAlertForSkippedRuns

boolean

pipelineTask

object

A list of task specification that the job will execute. See task Configuration Block below.

fullRefresh

boolean

pipelineId

string

pipelineIdRef

object

Reference to a Pipeline in compute to populate pipelineId.

name

required

string

namespace

string

policy

object

Policies for referencing.

resolution

string

resolve

string

pipelineIdSelector

object

Selector for a Pipeline in compute to populate pipelineId.

boolean

object

string

object

Policies for selection.

resolution

string

resolve

string

pythonWheelTask

object

A list of task specification that the job will execute. See task Configuration Block below.

string

object

string

array

Parameters for the task

retryOnTimeout

boolean

runIf

string

runJobTask

object

A list of task specification that the job will execute. See task Configuration Block below.

dbtCommands

array

(Array) Series of dbt commands to execute in sequence. Every command must start with "dbt".

jarParams

array

(No description available)

number

object

object

object

(No description available)

fullRefresh

boolean

pythonNamedParams

object

pythonParams

array

(No description available)

sparkSubmitParams

array

(No description available)

sqlParams

object

sparkJarTask

object

A list of task specification that the job will execute. See task Configuration Block below.

jarUri

string

mainClassName

string

parameters

array

Parameters for the task

runAsRepl

boolean

sparkPythonTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

pythonFile

string

source

string

sparkSubmitTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

sqlTask

object

A list of task specification that the job will execute. See task Configuration Block below.

alert

object

block consisting of following fields:

alertId

string

pauseSubscriptions

boolean

subscriptions

array

a list of subscription blocks consisting out of one of the required fields: user_name for user emails or destination_id - for Alert destination's identifier.

destinationId

string

userName

string

dashboard

object

block consisting of following fields:

string

string

boolean

array

a list of subscription blocks consisting out of one of the required fields: user_name for user emails or destination_id - for Alert destination's identifier.

destinationId

string

userName

string

file

object

block consisting of single string fields:

string

string

object

object

block consisting of single string field: query_id - identifier of the Databricks Query (databricks_query).

string

string

string

number

object

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

string

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

string

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

string

onStreamingBacklogExceeded

array

(No description available)

string

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

string

timeoutSeconds

number

trigger

object

The conditions that triggers the job to start. See trigger Configuration Block below.

fileArrival

object

configuration block to define a trigger for File Arrival events consisting of following attributes:

minTimeBetweenTriggersSeconds

number

url

string

waitAfterLastChangeSeconds

number

pauseStatus

string

periodic

object

configuration block to define a trigger for Periodic Triggers consisting of the following attributes:

interval

number

unit

string

table

object

(No description available)

condition

string

minTimeBetweenTriggersSeconds

number

tableNames

array

(No description available)

waitAfterLastChangeSeconds

number

tableUpdate

object

(No description available)

condition

string

minTimeBetweenTriggersSeconds

number

tableNames

array

(No description available)

waitAfterLastChangeSeconds

number

webhookNotifications

object

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

string

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

string

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

string

onStreamingBacklogExceeded

array

(No description available)

string

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

string

managementPolicies

array

THIS IS A BETA FIELD. It is on by default but can be opted out through a Crossplane feature flag. ManagementPolicies specify the array of actions Crossplane is allowed to take on the managed and external resources. See the design doc for more information: https://github.com/crossplane/crossplane/blob/499895a25d1a1a0ba1604944ef98ac7a1a71f197/design/design-doc-observe-only-resources.md?plain=1#L223 and this one: https://github.com/crossplane/crossplane/blob/444267e84783136daa93568b364a5f01228cacbe/design/one-pager-ignore-changes.md

providerConfigRef

object

ProviderConfigReference specifies how the provider that will be used to create, observe, update, and delete this managed resource should be configured.

kind

required

string

name

required

string

writeConnectionSecretToRef

object

WriteConnectionSecretToReference specifies the namespace and name of a Secret to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource.

name

required

string

status

object

JobStatus defines the observed state of Job.

atProvider

object

(No description available)

alwaysRunning

boolean

budgetPolicyId

string

continuous

object

Configuration block to configure pause status. See continuous Configuration Block.

pauseStatus

string

controlRunState

boolean

dbtTask

object

A list of task specification that the job will execute. See task Configuration Block below.

catalog

string

commands

array

(Array) Series of dbt commands to execute in sequence. Every command must start with "dbt".

string

string

string

string

string

object

(No description available)

string

string

string

string

object

(List) An optional set of email addresses notified when runs of this job begins, completes or fails. The default behavior is to not send any emails. This field is a block and is documented below.

noAlertForSkippedRuns

boolean

onDurationWarningThresholdExceeded

array

(List) list of notification IDs to call when the duration of a run exceeds the threshold specified by the RUN_DURATION_SECONDS metric in the health block.

onFailure

array

(List) list of notification IDs to call when the run fails. A maximum of 3 destinations can be specified.

onStart

array

(List) list of notification IDs to call when the run starts. A maximum of 3 destinations can be specified.

onStreamingBacklogExceeded

array

(No description available)

onSuccess

array

(List) list of notification IDs to call when the run completes successfully. A maximum of 3 destinations can be specified.

environment

array

(No description available)

environmentKey

string

spec

object

block describing the Environment. Consists of following attributes:

client

string

dependencies

array

(list of strings) List of pip dependencies, as supported by the version of pip in this environment. Each dependency is a pip requirement file line. See API docs for more information.

existingClusterId

string

format

string

gitSource

object

Specifices the a Git repository for task source code. See git_source Configuration Block below.

branch

string

commit

string

gitSnapshot

object

(No description available)

usedCommit

string

jobSource

object

The source of the project. Possible values are WORKSPACE and GIT. Defaults to GIT if a git_source block is present in the job definition.

string

string

string

string

string

string

object

An optional block that specifies the health conditions for the job documented below.

rules

array

(List) list of rules that are represented as objects with the following attributes:

metric

string

value

number

string

jobCluster

array

jobClusterKey

string

newCluster

object

Block with almost the same set of parameters as for databricks_cluster resource, except following (check the REST API documentation for full list of supported parameters):

applyPolicyDefaultValues

boolean

autoscale

object

(No description available)

maxWorkers

number

minWorkers

number

awsAttributes

object

(No description available)

string

number

number

number

number

string

number

string

number

string

object

(No description available)

availability

string

firstOnDemand

number

logAnalyticsInfo

object

(No description available)

logAnalyticsPrimaryKey

string

logAnalyticsWorkspaceId

string

spotBidMaxPrice

number

clusterId

string

clusterLogConf

object

(No description available)

dbfs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

array

(No description available)

localMountDirPath

string

networkFilesystemInfo

object

(No description available)

string

string

string

string

object

string

object

(No description available)

basicAuth

object

(No description available)

string

string

string

string

boolean

enableLocalDiskEncryption

boolean

gcpAttributes

object

(No description available)

string

number

string

number

usePreemptibleExecutors

boolean

zoneId

string

idempotencyToken

string

initScripts

array

(No description available)

abfss

object

(No description available)

destination

string

dbfs

object

(No description available)

destination

string

file

object

block consisting of single string fields:

destination

string

gcs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

object

(No description available)

destination

string

workspace

object

(No description available)

string

string

boolean

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

string

number

string

string

string

object

object

string

array

(No description available)

useMlRuntime

boolean

workloadType

object

isn't supported

clients

object

(No description available)

jobs

boolean

notebooks

boolean

library

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

number

number

minRetryIntervalMillis

number

name

string

newCluster

object

Task will run on a dedicated cluster. See databricks_cluster documentation for specification. Some parameters, such as

applyPolicyDefaultValues

boolean

autoscale

object

(No description available)

maxWorkers

number

minWorkers

number

awsAttributes

object

(No description available)

string

number

number

number

number

string

number

string

number

string

object

(No description available)

availability

string

firstOnDemand

number

logAnalyticsInfo

object

(No description available)

logAnalyticsPrimaryKey

string

logAnalyticsWorkspaceId

string

spotBidMaxPrice

number

clusterId

string

clusterLogConf

object

(No description available)

dbfs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

array

(No description available)

localMountDirPath

string

networkFilesystemInfo

object

(No description available)

string

string

string

string

object

string

object

(No description available)

basicAuth

object

(No description available)

string

string

string

string

boolean

enableLocalDiskEncryption

boolean

gcpAttributes

object

(No description available)

string

number

string

number

usePreemptibleExecutors

boolean

zoneId

string

idempotencyToken

string

initScripts

array

(No description available)

abfss

object

(No description available)

destination

string

dbfs

object

(No description available)

destination

string

file

object

block consisting of single string fields:

destination

string

gcs

object

(No description available)

destination

string

object

(No description available)

string

string

boolean

string

string

string

string

object

(No description available)

destination

string

workspace

object

(No description available)

string

string

boolean

string

array

(List) An optional list of libraries to be installed on the cluster that will execute the job. See library Configuration Block below.

cran

object

(No description available)

string

string

string

string

object

(No description available)

coordinates

string

exclusions

array

(No description available)

repo

string

pypi

object

(No description available)

string

string

string

string

string

number

string

string

string

object

object

string

array

(No description available)

useMlRuntime

boolean

workloadType

object

isn't supported

clients

object

(No description available)

jobs

boolean

notebooks

boolean

notebookTask

object

A list of task specification that the job will execute. See task Configuration Block below.

object

string

string

string

object

An optional block controlling the notification settings on the job level documented below.

noAlertForCanceledRuns

boolean

noAlertForSkippedRuns

boolean

parameter

array

Specifices job parameter for the job. See parameter Configuration Block

default

string

name

string

pipelineTask

object

A list of task specification that the job will execute. See task Configuration Block below.

fullRefresh

boolean

pipelineId

string

pythonWheelTask

object

A list of task specification that the job will execute. See task Configuration Block below.

string

object

string

array

Parameters for the task

queue

object

The queue status for the job. See queue Configuration Block below.

enabled

boolean

retryOnTimeout

boolean

runAs

object

The user or the service prinicipal the job runs as. See run_as Configuration Block below.

servicePrincipalName

string

userName

string

runJobTask

object

A list of task specification that the job will execute. See task Configuration Block below.

number

object

object

string

string

string

object

A list of task specification that the job will execute. See task Configuration Block below.

jarUri

string

mainClassName

string

parameters

array

Parameters for the task

sparkPythonTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task

pythonFile

string

source

string

sparkSubmitTask

object

A list of task specification that the job will execute. See task Configuration Block below.

parameters

array

Parameters for the task