You are viewing an outdated version of provider-aws-firehose.Go to Latest
upbound/provider-aws-firehose@v1.1.0
DeliveryStream
firehose.aws.upbound.io
DeliveryStream
upbound/provider-aws-firehose@v1.1.0firehose.aws.upbound.io

DeliveryStream is the Schema for the DeliveryStreams API. Provides a AWS Kinesis Firehose Delivery Stream

Type

CRD

Group

firehose.aws.upbound.io

Version

v1beta1

apiVersion: firehose.aws.upbound.io/v1beta1

kind: DeliveryStream

API Documentation
apiVersion
string
kind
string
metadata
object
spec
object
object

DeliveryStreamSpec defines the desired state of DeliveryStream

forProvider
requiredobject
requiredobject

No description provided.

arn
string
array

Configuration options when destination is elasticsearch. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

domainArn
string
object

Reference to a Domain in elasticsearch to populate domainArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Domain in elasticsearch to populate domainArn.

policy
object
object

Policies for selection.

resolve
string
indexName
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
typeName
string
array

The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. More details are given below

roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

A list of security group IDs to associate with Kinesis Firehose.

array

A list of subnet IDs to associate with Kinesis Firehose.

array

Enhanced configuration options for the s3 destination. More details are given below.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

array

Nested argument for the serializer, deserializer, and schema for converting data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. More details given below.

enabled
boolean
array

Nested argument that specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. More details below.

array

Nested argument that specifies which deserializer to use. You can choose either the Apache Hive JSON SerDe or the OpenX JSON SerDe. More details below.

array

Nested argument that specifies the native Hive / HCatalog JsonSerDe. More details below.

array

A list of how you want Kinesis Data Firehose to parse the date and time stamps that may be present in your input data JSON. To specify these format strings, follow the pattern syntax of JodaTime's DateTimeFormat format strings. For more information, see Class DateTimeFormat. You can also use the special value millis to parse time stamps in epoch milliseconds. If you don't specify a format, Kinesis Data Firehose uses java.sql.Timestamp::valueOf by default.

array

Nested argument that specifies the OpenX SerDe. More details below.

array

Nested argument that specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. More details below.

array

Nested argument that specifies which serializer to use. You can choose either the ORC SerDe or the Parquet SerDe. More details below.

array

Nested argument that specifies converting data to the ORC format before storing it in Amazon S3. For more information, see Apache ORC. More details below.

array

A list of column names for which you want Kinesis Data Firehose to create bloom filters.

array

Nested argument that specifies converting data to the Parquet format before storing it in Amazon S3. For more information, see Apache Parquet. More details below.

array

Nested argument that specifies the AWS Glue Data Catalog table that contains the column information. More details below.

catalogId
string
region
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
tableName
string
object

Reference to a CatalogTable in glue to populate tableName.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a CatalogTable in glue to populate tableName.

policy
object
object

Policies for selection.

resolve
string
versionId
string
array

The configuration for dynamic partitioning. See Dynamic Partitioning Configuration below for more details. Required when using dynamic partitioning.

kmsKeyArn
string
prefix
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.

bucketArn
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
array

Configuration options when destination is http_endpoint. Requires the user to also specify an s3_configuration block. More details are given below.

object

The access key required for Kinesis Firehose to authenticate with the HTTP endpoint selected as the destination.

key
requiredstring
name
requiredstring
namespace
requiredstring
array

The CloudWatch Logging Options for the delivery stream. More details are given below

name
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
array

The request configuration. More details are given below.

array

Describes the metadata sent to the HTTP endpoint destination. More details are given below

name
string
value
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
url
string
array

The stream and role Amazon Resource Names (ARNs) for a Kinesis data stream used as the source for a delivery stream. More details are given below.

array

The configuration for the Amazon MSK cluster to be used as the source for a delivery stream. More details are given below.

array

The authentication configuration of the Amazon MSK cluster. More details are given below.

topicName
string
name
string
array

Configuration options when destination is opensearch. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

domainArn
string
object

Reference to a Domain in opensearch to populate domainArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Domain in opensearch to populate domainArn.

policy
object
object

Policies for selection.

resolve
string
indexName
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
typeName
string
array

The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. More details are given below

roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

A list of security group IDs to associate with Kinesis Firehose.

array

A list of subnet IDs to associate with Kinesis Firehose.

array

Configuration options when destination is opensearchserverless. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

object

Reference to a Collection in opensearchserverless to populate collectionEndpoint.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Collection in opensearchserverless to populate collectionEndpoint.

policy
object
object

Policies for selection.

resolve
string
indexName
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. More details are given below

roleArn
string
array

A list of security group IDs to associate with Kinesis Firehose.

array

A list of subnet IDs to associate with Kinesis Firehose.

array

Configuration options when destination is redshift. Requires the user to also specify an s3_configuration block. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

passwordSecretRef
requiredobject
requiredobject

The password for the username above.

key
requiredstring
name
requiredstring
namespace
requiredstring
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
username
string
region
requiredstring
array

Encrypt at rest options. Server-side encryption should not be enabled when a kinesis stream is configured as the source of the firehose delivery stream.

enabled
boolean
keyArn
string
keyType
string
array

Configuration options when destination is splunk. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

hecTokenSecretRef
requiredobject
requiredobject

The GUID that you obtain from your Splunk cluster when you create a new HEC endpoint.

key
requiredstring
name
requiredstring
namespace
requiredstring
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
tags
object
versionId
string
object

THIS IS A BETA FIELD. It will be honored unless the Management Policies feature flag is disabled. InitProvider holds the same fields as ForProvider, with the exception of Identifier and other resource reference fields. The fields that are in InitProvider are merged into ForProvider when the resource is created. The same fields are also added to the terraform ignore_changes hook, to avoid updating them after creation. This is useful for fields that are required on creation, but we do not desire to update them after creation, for example because of an external controller is managing them, like an autoscaler.

arn
string
array

Configuration options when destination is elasticsearch. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

domainArn
string
object

Reference to a Domain in elasticsearch to populate domainArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Domain in elasticsearch to populate domainArn.

policy
object
object

Policies for selection.

resolve
string
indexName
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
typeName
string
array

The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. More details are given below

roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

A list of security group IDs to associate with Kinesis Firehose.

array

A list of subnet IDs to associate with Kinesis Firehose.

array

Enhanced configuration options for the s3 destination. More details are given below.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

array

Nested argument for the serializer, deserializer, and schema for converting data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. More details given below.

enabled
boolean
array

Nested argument that specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. More details below.

array

Nested argument that specifies which deserializer to use. You can choose either the Apache Hive JSON SerDe or the OpenX JSON SerDe. More details below.

array

Nested argument that specifies the native Hive / HCatalog JsonSerDe. More details below.

array

A list of how you want Kinesis Data Firehose to parse the date and time stamps that may be present in your input data JSON. To specify these format strings, follow the pattern syntax of JodaTime's DateTimeFormat format strings. For more information, see Class DateTimeFormat. You can also use the special value millis to parse time stamps in epoch milliseconds. If you don't specify a format, Kinesis Data Firehose uses java.sql.Timestamp::valueOf by default.

array

Nested argument that specifies the OpenX SerDe. More details below.

array

Nested argument that specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. More details below.

array

Nested argument that specifies which serializer to use. You can choose either the ORC SerDe or the Parquet SerDe. More details below.

array

Nested argument that specifies converting data to the ORC format before storing it in Amazon S3. For more information, see Apache ORC. More details below.

array

A list of column names for which you want Kinesis Data Firehose to create bloom filters.

array

Nested argument that specifies converting data to the Parquet format before storing it in Amazon S3. For more information, see Apache Parquet. More details below.

array

Nested argument that specifies the AWS Glue Data Catalog table that contains the column information. More details below.

catalogId
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
tableName
string
object

Reference to a CatalogTable in glue to populate tableName.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a CatalogTable in glue to populate tableName.

policy
object
object

Policies for selection.

resolve
string
versionId
string
array

The configuration for dynamic partitioning. See Dynamic Partitioning Configuration below for more details. Required when using dynamic partitioning.

kmsKeyArn
string
prefix
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.

bucketArn
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
array

Configuration options when destination is http_endpoint. Requires the user to also specify an s3_configuration block. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

name
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
array

The request configuration. More details are given below.

array

Describes the metadata sent to the HTTP endpoint destination. More details are given below

name
string
value
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
url
string
array

The stream and role Amazon Resource Names (ARNs) for a Kinesis data stream used as the source for a delivery stream. More details are given below.

array

The configuration for the Amazon MSK cluster to be used as the source for a delivery stream. More details are given below.

array

The authentication configuration of the Amazon MSK cluster. More details are given below.

topicName
string
name
string
array

Configuration options when destination is opensearch. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

domainArn
string
object

Reference to a Domain in opensearch to populate domainArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Domain in opensearch to populate domainArn.

policy
object
object

Policies for selection.

resolve
string
indexName
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
typeName
string
array

The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. More details are given below

roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

A list of security group IDs to associate with Kinesis Firehose.

array

A list of subnet IDs to associate with Kinesis Firehose.

array

Configuration options when destination is opensearchserverless. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

object

Reference to a Collection in opensearchserverless to populate collectionEndpoint.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Collection in opensearchserverless to populate collectionEndpoint.

policy
object
object

Policies for selection.

resolve
string
indexName
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. More details are given below

roleArn
string
array

A list of security group IDs to associate with Kinesis Firehose.

array

A list of subnet IDs to associate with Kinesis Firehose.

array

Configuration options when destination is redshift. Requires the user to also specify an s3_configuration block. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
username
string
array

Encrypt at rest options. Server-side encryption should not be enabled when a kinesis stream is configured as the source of the firehose delivery stream.

enabled
boolean
keyArn
string
keyType
string
array

Configuration options when destination is splunk. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
object

Reference to a Bucket in s3 to populate bucketArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Bucket in s3 to populate bucketArn.

policy
object
object

Policies for selection.

resolve
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
object

Reference to a Role in iam to populate roleArn.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate roleArn.

policy
object
object

Policies for selection.

resolve
string
tags
object
versionId
string
array

THIS IS A BETA FIELD. It is on by default but can be opted out through a Crossplane feature flag. ManagementPolicies specify the array of actions Crossplane is allowed to take on the managed and external resources. This field is planned to replace the DeletionPolicy field in a future release. Currently, both could be set independently and non-default values would be honored if the feature flag is enabled. If both are custom, the DeletionPolicy field will be ignored. See the design doc for more information: https://github.com/crossplane/crossplane/blob/499895a25d1a1a0ba1604944ef98ac7a1a71f197/design/design-doc-observe-only-resources.md?plain=1#L223 and this one: https://github.com/crossplane/crossplane/blob/444267e84783136daa93568b364a5f01228cacbe/design/one-pager-ignore-changes.md

object

ProviderConfigReference specifies how the provider that will be used to create, observe, update, and delete this managed resource should be configured.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

PublishConnectionDetailsTo specifies the connection secret config which contains a name, metadata and a reference to secret store config to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource.

configRef
object
object

SecretStoreConfigRef specifies which secret store config should be used for this ConnectionSecret.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
metadata
object
object

Metadata is the metadata for connection secret.

labels
object
type
string
name
requiredstring
object

WriteConnectionSecretToReference specifies the namespace and name of a Secret to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource. This field is planned to be replaced in a future release in favor of PublishConnectionDetailsTo. Currently, both could be set independently and connection details would be published to both without affecting each other.

name
requiredstring
namespace
requiredstring
status
object
object

DeliveryStreamStatus defines the observed state of DeliveryStream.

object

No description provided.

arn
string
array

Configuration options when destination is elasticsearch. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

domainArn
string
indexName
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
typeName
string
array

The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. More details are given below

roleArn
string
array

A list of security group IDs to associate with Kinesis Firehose.

array

A list of subnet IDs to associate with Kinesis Firehose.

vpcId
string
array

Enhanced configuration options for the s3 destination. More details are given below.

bucketArn
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

array

Nested argument for the serializer, deserializer, and schema for converting data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. More details given below.

enabled
boolean
array

Nested argument that specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. More details below.

array

Nested argument that specifies which deserializer to use. You can choose either the Apache Hive JSON SerDe or the OpenX JSON SerDe. More details below.

array

Nested argument that specifies the native Hive / HCatalog JsonSerDe. More details below.

array

A list of how you want Kinesis Data Firehose to parse the date and time stamps that may be present in your input data JSON. To specify these format strings, follow the pattern syntax of JodaTime's DateTimeFormat format strings. For more information, see Class DateTimeFormat. You can also use the special value millis to parse time stamps in epoch milliseconds. If you don't specify a format, Kinesis Data Firehose uses java.sql.Timestamp::valueOf by default.

array

Nested argument that specifies the OpenX SerDe. More details below.

array

Nested argument that specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. More details below.

array

Nested argument that specifies which serializer to use. You can choose either the ORC SerDe or the Parquet SerDe. More details below.

array

Nested argument that specifies converting data to the ORC format before storing it in Amazon S3. For more information, see Apache ORC. More details below.

array

A list of column names for which you want Kinesis Data Firehose to create bloom filters.

array

Nested argument that specifies converting data to the Parquet format before storing it in Amazon S3. For more information, see Apache Parquet. More details below.

array

Nested argument that specifies the AWS Glue Data Catalog table that contains the column information. More details below.

catalogId
string
region
string
roleArn
string
tableName
string
versionId
string
array

The configuration for dynamic partitioning. See Dynamic Partitioning Configuration below for more details. Required when using dynamic partitioning.

kmsKeyArn
string
prefix
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
array

The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.

bucketArn
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
array

Configuration options when destination is http_endpoint. Requires the user to also specify an s3_configuration block. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

name
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
array

The request configuration. More details are given below.

array

Describes the metadata sent to the HTTP endpoint destination. More details are given below

name
string
value
string
roleArn
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
url
string
id
string
array

The stream and role Amazon Resource Names (ARNs) for a Kinesis data stream used as the source for a delivery stream. More details are given below.

array

The configuration for the Amazon MSK cluster to be used as the source for a delivery stream. More details are given below.

array

The authentication configuration of the Amazon MSK cluster. More details are given below.

topicName
string
name
string
array

Configuration options when destination is opensearch. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

domainArn
string
indexName
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
typeName
string
array

The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. More details are given below

roleArn
string
array

A list of security group IDs to associate with Kinesis Firehose.

array

A list of subnet IDs to associate with Kinesis Firehose.

vpcId
string
array

Configuration options when destination is opensearchserverless. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

indexName
string
array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
array

The VPC configuration for the delivery stream to connect to Elastic Search associated with the VPC. More details are given below

roleArn
string
array

A list of security group IDs to associate with Kinesis Firehose.

array

A list of subnet IDs to associate with Kinesis Firehose.

vpcId
string
array

Configuration options when destination is redshift. Requires the user to also specify an s3_configuration block. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
roleArn
string
array

The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.

bucketArn
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
username
string
array

Encrypt at rest options. Server-side encryption should not be enabled when a kinesis stream is configured as the source of the firehose delivery stream.

enabled
boolean
keyArn
string
keyType
string
array

Configuration options when destination is splunk. More details are given below.

array

The CloudWatch Logging Options for the delivery stream. More details are given below

array

The data processing configuration. More details are given below.

enabled
boolean
array

Array of data processors. More details are given below

array

Array of processor parameters. More details are given below

type
string
array

The S3 Configuration. See s3_configuration for more details.

bucketArn
string
array

The CloudWatch Logging Options for the delivery stream. More details are given below

kmsKeyArn
string
prefix
string
roleArn
string
tags
object
tagsAll
object
versionId
string
array

Conditions of the resource.

lastTransitionTime
requiredstring
message
string
reason
requiredstring
status
requiredstring
type
requiredstring
Discover the building blocks for your internal cloud platform.
© 2024 Upbound, Inc.
Solutions