DeliveryStream is the Schema for the DeliveryStreams API. Provides a AWS Kinesis Firehose Delivery Stream
Type
CRD
Group
firehose.aws.upbound.io
Version
apiVersion: firehose.aws.upbound.io/v1beta1
kind: DeliveryStream
DeliveryStreamSpec defines the desired state of DeliveryStream
No description provided.
Configuration options when destination is elasticsearch. See elasticsearch_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Domain in elasticsearch to populate domainArn.
Policies for referencing.
Selector for a Domain in elasticsearch to populate domainArn.
Policies for selection.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 Configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. See vpc_config block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
A list of security group IDs to associate with Kinesis Firehose.
A list of subnet IDs to associate with Kinesis Firehose.
Enhanced configuration options for the s3 destination. See extended_s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Nested argument for the serializer, deserializer, and schema for converting data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. See data_format_conversion_configuration block below for details.
Specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. See input_format_configuration block below for details.
Specifies which deserializer to use. You can choose either the Apache Hive JSON SerDe or the OpenX JSON SerDe. See deserializer block below for details.
Specifies the native Hive / HCatalog JsonSerDe. More details below. See hive_json_ser_de block below for details.
A list of how you want Kinesis Data Firehose to parse the date and time stamps that may be present in your input data JSON. To specify these format strings, follow the pattern syntax of JodaTime's DateTimeFormat format strings. For more information, see Class DateTimeFormat. You can also use the special value millis to parse time stamps in epoch milliseconds. If you don't specify a format, Kinesis Data Firehose uses java.sql.Timestamp::valueOf by default.
Specifies the OpenX SerDe. See open_x_json_ser_de block below for details.
Specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. See output_format_configuration block below for details.
Specifies which serializer to use. You can choose either the ORC SerDe or the Parquet SerDe. See serializer block below for details.
Specifies converting data to the ORC format before storing it in Amazon S3. For more information, see Apache ORC. See orc_ser_de block below for details.
A list of column names for which you want Kinesis Data Firehose to create bloom filters.
Specifies converting data to the Parquet format before storing it in Amazon S3. For more information, see Apache Parquet. More details below.
Specifies the AWS Glue Data Catalog table that contains the column information. See schema_configuration block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
Reference to a CatalogTable in glue to populate tableName.
Policies for referencing.
Selector for a CatalogTable in glue to populate tableName.
Policies for selection.
The configuration for dynamic partitioning. Required when using dynamic partitioning. See dynamic_partitioning_configuration block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Configuration options when destination is http_endpoint. Requires the user to also specify an s3_configuration block. See http_endpoint_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The request configuration. See request_configuration block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 Configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The stream and role Amazon Resource Names (ARNs) for a Kinesis data stream used as the source for a delivery stream. See kinesis_source_configuration block below for details.
The configuration for the Amazon MSK cluster to be used as the source for a delivery stream. See msk_source_configuration block below for details.
The authentication configuration of the Amazon MSK cluster. See authentication_configuration block below for details.
Configuration options when destination is opensearch. See opensearch_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The method for setting up document ID. See [document_id_options block] below for details.
Reference to a Domain in opensearch to populate domainArn.
Policies for referencing.
Selector for a Domain in opensearch to populate domainArn.
Policies for selection.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 Configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The VPC configuration for the delivery stream to connect to OpenSearch associated with the VPC. See vpc_config block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
A list of security group IDs to associate with Kinesis Firehose.
A list of subnet IDs to associate with Kinesis Firehose.
Configuration options when destination is opensearchserverless. See opensearchserverless_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Collection in opensearchserverless to populate collectionEndpoint.
Policies for referencing.
Selector for a Collection in opensearchserverless to populate collectionEndpoint.
Policies for selection.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 Configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The VPC configuration for the delivery stream to connect to OpenSearch Serverless associated with the VPC. See vpc_config block below for details.
A list of security group IDs to associate with Kinesis Firehose.
A list of subnet IDs to associate with Kinesis Firehose.
Configuration options when destination is redshift. Requires the user to also specify an s3_configuration block. See redshift_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 Configuration. See s3_configuration below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
Configuration options when destination is snowflake. See snowflake_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The configuration for Snowflake role.
The VPC configuration for Snowflake.
Configuration options when destination is splunk. See splunk_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The S3 Configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
THIS IS A BETA FIELD. It will be honored unless the Management Policies feature flag is disabled. InitProvider holds the same fields as ForProvider, with the exception of Identifier and other resource reference fields. The fields that are in InitProvider are merged into ForProvider when the resource is created. The same fields are also added to the terraform ignore_changes hook, to avoid updating them after creation. This is useful for fields that are required on creation, but we do not desire to update them after creation, for example because of an external controller is managing them, like an autoscaler.
Configuration options when destination is elasticsearch. See elasticsearch_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Domain in elasticsearch to populate domainArn.
Policies for referencing.
Selector for a Domain in elasticsearch to populate domainArn.
Policies for selection.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 Configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. See vpc_config block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
A list of security group IDs to associate with Kinesis Firehose.
A list of subnet IDs to associate with Kinesis Firehose.
Enhanced configuration options for the s3 destination. See extended_s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Nested argument for the serializer, deserializer, and schema for converting data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. See data_format_conversion_configuration block below for details.
Specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. See input_format_configuration block below for details.
Specifies which deserializer to use. You can choose either the Apache Hive JSON SerDe or the OpenX JSON SerDe. See deserializer block below for details.
Specifies the native Hive / HCatalog JsonSerDe. More details below. See hive_json_ser_de block below for details.
A list of how you want Kinesis Data Firehose to parse the date and time stamps that may be present in your input data JSON. To specify these format strings, follow the pattern syntax of JodaTime's DateTimeFormat format strings. For more information, see Class DateTimeFormat. You can also use the special value millis to parse time stamps in epoch milliseconds. If you don't specify a format, Kinesis Data Firehose uses java.sql.Timestamp::valueOf by default.
Specifies the OpenX SerDe. See open_x_json_ser_de block below for details.
Specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. See output_format_configuration block below for details.
Specifies which serializer to use. You can choose either the ORC SerDe or the Parquet SerDe. See serializer block below for details.
Specifies converting data to the ORC format before storing it in Amazon S3. For more information, see Apache ORC. See orc_ser_de block below for details.
A list of column names for which you want Kinesis Data Firehose to create bloom filters.
Specifies converting data to the Parquet format before storing it in Amazon S3. For more information, see Apache Parquet. More details below.
Specifies the AWS Glue Data Catalog table that contains the column information. See schema_configuration block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
Reference to a CatalogTable in glue to populate tableName.
Policies for referencing.
Selector for a CatalogTable in glue to populate tableName.
Policies for selection.
The configuration for dynamic partitioning. Required when using dynamic partitioning. See dynamic_partitioning_configuration block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Configuration options when destination is http_endpoint. Requires the user to also specify an s3_configuration block. See http_endpoint_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The request configuration. See request_configuration block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 Configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The stream and role Amazon Resource Names (ARNs) for a Kinesis data stream used as the source for a delivery stream. See kinesis_source_configuration block below for details.
The configuration for the Amazon MSK cluster to be used as the source for a delivery stream. See msk_source_configuration block below for details.
The authentication configuration of the Amazon MSK cluster. See authentication_configuration block below for details.
Configuration options when destination is opensearch. See opensearch_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The method for setting up document ID. See [document_id_options block] below for details.
Reference to a Domain in opensearch to populate domainArn.
Policies for referencing.
Selector for a Domain in opensearch to populate domainArn.
Policies for selection.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 Configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The VPC configuration for the delivery stream to connect to OpenSearch associated with the VPC. See vpc_config block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
A list of security group IDs to associate with Kinesis Firehose.
A list of subnet IDs to associate with Kinesis Firehose.
Configuration options when destination is opensearchserverless. See opensearchserverless_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Collection in opensearchserverless to populate collectionEndpoint.
Policies for referencing.
Selector for a Collection in opensearchserverless to populate collectionEndpoint.
Policies for selection.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 Configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The VPC configuration for the delivery stream to connect to OpenSearch Serverless associated with the VPC. See vpc_config block below for details.
A list of security group IDs to associate with Kinesis Firehose.
A list of subnet IDs to associate with Kinesis Firehose.
Configuration options when destination is redshift. Requires the user to also specify an s3_configuration block. See redshift_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 Configuration. See s3_configuration below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
Configuration options when destination is snowflake. See snowflake_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The S3 configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
The configuration for Snowflake role.
The VPC configuration for Snowflake.
Configuration options when destination is splunk. See splunk_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The S3 Configuration. See s3_configuration block below for details.
Reference to a Bucket in s3 to populate bucketArn.
Policies for referencing.
Selector for a Bucket in s3 to populate bucketArn.
Policies for selection.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Reference to a Role in iam to populate roleArn.
Policies for referencing.
Selector for a Role in iam to populate roleArn.
Policies for selection.
THIS IS A BETA FIELD. It is on by default but can be opted out through a Crossplane feature flag. ManagementPolicies specify the array of actions Crossplane is allowed to take on the managed and external resources. This field is planned to replace the DeletionPolicy field in a future release. Currently, both could be set independently and non-default values would be honored if the feature flag is enabled. If both are custom, the DeletionPolicy field will be ignored. See the design doc for more information: https://github.com/crossplane/crossplane/blob/499895a25d1a1a0ba1604944ef98ac7a1a71f197/design/design-doc-observe-only-resources.md?plain=1#L223 and this one: https://github.com/crossplane/crossplane/blob/444267e84783136daa93568b364a5f01228cacbe/design/one-pager-ignore-changes.md
ProviderConfigReference specifies how the provider that will be used to create, observe, update, and delete this managed resource should be configured.
Policies for referencing.
PublishConnectionDetailsTo specifies the connection secret config which contains a name, metadata and a reference to secret store config to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource.
WriteConnectionSecretToReference specifies the namespace and name of a Secret to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource. This field is planned to be replaced in a future release in favor of PublishConnectionDetailsTo. Currently, both could be set independently and connection details would be published to both without affecting each other.
DeliveryStreamStatus defines the observed state of DeliveryStream.
No description provided.
Configuration options when destination is elasticsearch. See elasticsearch_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The S3 Configuration. See s3_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. See vpc_config block below for details.
A list of security group IDs to associate with Kinesis Firehose.
A list of subnet IDs to associate with Kinesis Firehose.
Enhanced configuration options for the s3 destination. See extended_s3_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Nested argument for the serializer, deserializer, and schema for converting data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. See data_format_conversion_configuration block below for details.
Specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. See input_format_configuration block below for details.
Specifies which deserializer to use. You can choose either the Apache Hive JSON SerDe or the OpenX JSON SerDe. See deserializer block below for details.
Specifies the native Hive / HCatalog JsonSerDe. More details below. See hive_json_ser_de block below for details.
A list of how you want Kinesis Data Firehose to parse the date and time stamps that may be present in your input data JSON. To specify these format strings, follow the pattern syntax of JodaTime's DateTimeFormat format strings. For more information, see Class DateTimeFormat. You can also use the special value millis to parse time stamps in epoch milliseconds. If you don't specify a format, Kinesis Data Firehose uses java.sql.Timestamp::valueOf by default.
Specifies the OpenX SerDe. See open_x_json_ser_de block below for details.
Specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. See output_format_configuration block below for details.
Specifies which serializer to use. You can choose either the ORC SerDe or the Parquet SerDe. See serializer block below for details.
Specifies converting data to the ORC format before storing it in Amazon S3. For more information, see Apache ORC. See orc_ser_de block below for details.
A list of column names for which you want Kinesis Data Firehose to create bloom filters.
Specifies converting data to the Parquet format before storing it in Amazon S3. For more information, see Apache Parquet. More details below.
The configuration for dynamic partitioning. Required when using dynamic partitioning. See dynamic_partitioning_configuration block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Configuration options when destination is http_endpoint. Requires the user to also specify an s3_configuration block. See http_endpoint_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The request configuration. See request_configuration block below for details.
The S3 Configuration. See s3_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The stream and role Amazon Resource Names (ARNs) for a Kinesis data stream used as the source for a delivery stream. See kinesis_source_configuration block below for details.
The configuration for the Amazon MSK cluster to be used as the source for a delivery stream. See msk_source_configuration block below for details.
The authentication configuration of the Amazon MSK cluster. See authentication_configuration block below for details.
Configuration options when destination is opensearch. See opensearch_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The method for setting up document ID. See [document_id_options block] below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The S3 Configuration. See s3_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The VPC configuration for the delivery stream to connect to OpenSearch associated with the VPC. See vpc_config block below for details.
A list of security group IDs to associate with Kinesis Firehose.
A list of subnet IDs to associate with Kinesis Firehose.
Configuration options when destination is opensearchserverless. See opensearchserverless_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The S3 Configuration. See s3_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The VPC configuration for the delivery stream to connect to OpenSearch Serverless associated with the VPC. See vpc_config block below for details.
A list of security group IDs to associate with Kinesis Firehose.
A list of subnet IDs to associate with Kinesis Firehose.
Configuration options when destination is redshift. Requires the user to also specify an s3_configuration block. See redshift_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The S3 Configuration. See s3_configuration below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Configuration options when destination is snowflake. See snowflake_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The S3 configuration. See s3_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The configuration for Snowflake role.
The VPC configuration for Snowflake.
Configuration options when destination is splunk. See splunk_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
The data processing configuration. See processing_configuration block below for details.
Specifies the data processors as multiple blocks. See processors block below for details.
Specifies the processor parameters as multiple blocks. See parameters block below for details.
The S3 Configuration. See s3_configuration block below for details.
The CloudWatch Logging Options for the delivery stream. See cloudwatch_logging_options block below for details.
Conditions of the resource.
example
apiVersion: firehose.aws.upbound.io/v1beta1
kind: DeliveryStream
metadata:
annotations:
meta.upbound.io/example-id: firehose/v1beta1/firehose
labels:
testing.upbound.io/example-name: firehose
name: example
spec:
forProvider:
destination: extended_s3
extendedS3Configuration:
- bucketArnSelector:
matchLabels:
testing.upbound.io/example-name: firehose
roleArnSelector:
matchLabels:
testing.upbound.io/example-name: firehose
name: example
region: us-west-1
© 2022 Upbound, Inc.
Discover the building blocksfor your internal cloud platform.