SparkCluster is the Schema for the SparkClusters API. Manages a HDInsight Spark Cluster.
Type
CRD
Group
hdinsight.azure.upbound.io
Version
v1beta1
apiVersion: hdinsight.azure.upbound.io/v1beta1
kind: SparkCluster
SparkClusterSpec defines the desired state of SparkCluster
No description provided.
A component_version block as defined below.
A compute_isolation block as defined below.
One or more disk_encryption block as defined below.
An extension block as defined below.
A gateway block as defined below.
A metastores block as defined below.
An ambari block as defined below.
A hive block as defined below.
An oozie block as defined below.
A monitor block as defined below.
A network block as defined below.
Reference to a ResourceGroup in azure to populate resourceGroupName.
Policies for referencing.
Selector for a ResourceGroup in azure to populate resourceGroupName.
Policies for selection.
A roles block as defined below.
A head_node block as defined above.
The script action which will run on the cluster. Changing this forces a new resource to be created.
A list of SSH Keys which should be used for the local administrator on the Zookeeper Nodes. Changing this forces a new resource to be created.
Reference to a Subnet in network to populate subnetId.
Policies for referencing.
Selector for a Subnet in network to populate subnetId.
Policies for selection.
A worker_node block as defined below.
A autoscale block as defined below.
A capacity block as defined below.
A recurrence block as defined below.
A list of schedule blocks as defined below.
The days of the week to perform autoscale. Possible values are Monday, Tuesday, Wednesday, Thursday, Friday, Saturday and Sunday.
The script action which will run on the cluster. Changing this forces a new resource to be created.
A list of SSH Keys which should be used for the local administrator on the Zookeeper Nodes. Changing this forces a new resource to be created.
Reference to a Subnet in network to populate subnetId.
Policies for referencing.
Selector for a Subnet in network to populate subnetId.
Policies for selection.
A zookeeper_node block as defined below.
The script action which will run on the cluster. Changing this forces a new resource to be created.
A list of SSH Keys which should be used for the local administrator on the Zookeeper Nodes. Changing this forces a new resource to be created.
Reference to a Subnet in network to populate subnetId.
Policies for referencing.
Selector for a Subnet in network to populate subnetId.
Policies for selection.
A security_profile block as defined below. Changing this forces a new resource to be created.
A list of the distinguished names for the cluster user groups. Changing this forces a new resource to be created.
A list of the LDAPS URLs to communicate with the Azure Active Directory. Changing this forces a new resource to be created.
One or more storage_account block as defined below.
Reference to a Container in storage to populate storageContainerId.
Policies for referencing.
Selector for a Container in storage to populate storageContainerId.
Policies for selection.
A storage_account_gen2 block as defined below.
ProviderConfigReference specifies how the provider that will be used to create, observe, update, and delete this managed resource should be configured.
Policies for referencing.
ProviderReference specifies the provider that will be used to create, observe, update, and delete this managed resource. Deprecated: Please use ProviderConfigReference, i.e. providerConfigRef
Policies for referencing.
PublishConnectionDetailsTo specifies the connection secret config which contains a name, metadata and a reference to secret store config to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource.
WriteConnectionSecretToReference specifies the namespace and name of a Secret to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource. This field is planned to be replaced in a future release in favor of PublishConnectionDetailsTo. Currently, both could be set independently and connection details would be published to both without affecting each other.
SparkClusterStatus defines the observed state of SparkCluster.
No description provided.
A component_version block as defined below.
A compute_isolation block as defined below.
One or more disk_encryption block as defined below.
An extension block as defined below.
A monitor block as defined below.
A network block as defined below.
A roles block as defined below.
A head_node block as defined above.
The script action which will run on the cluster. Changing this forces a new resource to be created.
A list of SSH Keys which should be used for the local administrator on the Zookeeper Nodes. Changing this forces a new resource to be created.
A worker_node block as defined below.
A autoscale block as defined below.
A capacity block as defined below.
A recurrence block as defined below.
A list of schedule blocks as defined below.
The days of the week to perform autoscale. Possible values are Monday, Tuesday, Wednesday, Thursday, Friday, Saturday and Sunday.
The script action which will run on the cluster. Changing this forces a new resource to be created.
A list of SSH Keys which should be used for the local administrator on the Zookeeper Nodes. Changing this forces a new resource to be created.
A zookeeper_node block as defined below.
The script action which will run on the cluster. Changing this forces a new resource to be created.
A list of SSH Keys which should be used for the local administrator on the Zookeeper Nodes. Changing this forces a new resource to be created.
A security_profile block as defined below. Changing this forces a new resource to be created.
A list of the distinguished names for the cluster user groups. Changing this forces a new resource to be created.
A list of the LDAPS URLs to communicate with the Azure Active Directory. Changing this forces a new resource to be created.
One or more storage_account block as defined below.
A storage_account_gen2 block as defined below.
Conditions of the resource.
sparkcluster001
apiVersion: hdinsight.azure.upbound.io/v1beta1
kind: SparkCluster
metadata:
annotations:
meta.upbound.io/example-id: hdinsight/v1beta1/sparkcluster
uptest.upbound.io/timeout: "3600"
labels:
testing.upbound.io/example-name: sparkcluster001
name: sparkcluster001
spec:
forProvider:
clusterVersion: "4.0"
componentVersion:
- spark: "2.4"
gateway:
- passwordSecretRef:
key: example-key
name: example-secret
namespace: upbound-system
username: acctestusrgw
location: West Europe
resourceGroupNameSelector:
matchLabels:
testing.upbound.io/example-name: rgsparkcluster
roles:
- headNode:
- passwordSecretRef:
key: example-key
name: example-secret
namespace: upbound-system
username: acctestusrvm
vmSize: Standard_A4_V2
workerNode:
- passwordSecretRef:
key: example-key
name: example-secret
namespace: upbound-system
targetInstanceCount: 1
username: acctestusrvm
vmSize: Standard_A4_V2
zookeeperNode:
- passwordSecretRef:
key: example-key
name: example-secret
namespace: upbound-system
username: acctestusrvm
vmSize: Medium
storageAccount:
- isDefault: true
storageAccountKeySecretRef:
key: attribute.primary_access_key
name: example-storage-account
namespace: upbound-system
storageContainerIdSelector:
matchLabels:
testing.upbound.io/example-name: example
tier: Standard
© 2022 Upbound, Inc.
Discover the building blocksfor your internal cloud platform.