Marketplace
BrowsePublish
Marketplace
You are viewing an outdated version of provider-aws.Go to Latest
upbound/provider-aws@v0.28.0
Crawler
glue.aws.upbound.io
Crawler
upbound/provider-aws@v0.28.0glue.aws.upbound.io

Crawler is the Schema for the Crawlers API. Manages a Glue Crawler

Type

CRD

Group

glue.aws.upbound.io

Version

v1beta1

apiVersion: glue.aws.upbound.io/v1beta1

kind: Crawler

API Documentation
apiVersion
string
kind
string
metadata
object
spec
object
object

CrawlerSpec defines the desired state of Crawler

forProvider
requiredobject
requiredobject

No description provided.

array

No description provided.

object

Reference to a CatalogDatabase in glue to populate databaseName.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a CatalogDatabase in glue to populate databaseName.

policy
object
object

Policies for selection.

resolve
string
tables
requiredarray
requiredarray

A list of catalog tables to be synchronized.

array

List of custom classifiers. By default, all AWS classifiers are included in a crawl, but these custom classifiers always override the default classifiers for a given classification.

object

Reference to a CatalogDatabase in glue to populate databaseName.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a CatalogDatabase in glue to populate databaseName.

policy
object
object

Policies for selection.

resolve
string
array

No description provided.

connectionName
requiredstring
deltaTables
requiredarray
requiredarray

A list of the Amazon S3 paths to the Delta tables.

writeManifest
requiredboolean
array

List of nested DynamoDB target arguments. See Dynamodb Target below.

path
requiredstring
scanAll
boolean
scanRate
number
array

List of nested JBDC target arguments. See JDBC Target below.

object

Reference to a Connection in glue to populate connectionName.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Connection in glue to populate connectionName.

policy
object
object

Policies for selection.

resolve
string
array

A list of glob patterns used to exclude from the crawl.

path
requiredstring
array

Specifies data lineage configuration settings for the crawler. See Lineage Configuration below.

array

List nested MongoDB target arguments. See MongoDB Target below.

object

Reference to a Connection in glue to populate connectionName.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Connection in glue to populate connectionName.

policy
object
object

Policies for selection.

resolve
string
path
requiredstring
scanAll
boolean
array

A policy that specifies whether to crawl the entire dataset again, or to crawl only folders that were added since the last crawler run.. See Recrawl Policy below.

region
requiredstring
role
string
roleRef
object
object

Reference to a Role in iam to populate role.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

Selector for a Role in iam to populate role.

policy
object
object

Policies for selection.

resolve
string
array

List nested Amazon S3 target arguments. See S3 Target below.

array

A list of glob patterns used to exclude from the crawl.

path
requiredstring
schedule
string
array

Policy for the crawler's update and deletion behavior. See Schema Change Policy below.

tags
object
object

ProviderConfigReference specifies how the provider that will be used to create, observe, update, and delete this managed resource should be configured.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

ProviderReference specifies the provider that will be used to create, observe, update, and delete this managed resource. Deprecated: Please use ProviderConfigReference, i.e. providerConfigRef

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
object

PublishConnectionDetailsTo specifies the connection secret config which contains a name, metadata and a reference to secret store config to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource.

configRef
object
object

SecretStoreConfigRef specifies which secret store config should be used for this ConnectionSecret.

name
requiredstring
policy
object
object

Policies for referencing.

resolve
string
metadata
object
object

Metadata is the metadata for connection secret.

labels
object
type
string
name
requiredstring
object

WriteConnectionSecretToReference specifies the namespace and name of a Secret to which any connection details for this managed resource should be written. Connection details frequently include the endpoint, username, and password required to connect to the managed resource. This field is planned to be replaced in a future release in favor of PublishConnectionDetailsTo. Currently, both could be set independently and connection details would be published to both without affecting each other.

name
requiredstring
namespace
requiredstring
status
object
object

CrawlerStatus defines the observed state of Crawler.

object

No description provided.

arn
string
id
string
tagsAll
object
array

Conditions of the resource.

lastTransitionTime
requiredstring
message
string
reason
requiredstring
status
requiredstring
type
requiredstring
Marketplace

Discover the building blocks for your internal cloud platform.

© 2022 Upbound, Inc.

SolutionsProvidersConfigurations
LearnDocumentationTry for Free
MorePrivacy PolicyTerms & Conditions
Marketplace

© 2022 Upbound, Inc.

Marketplace

Discover the building blocksfor your internal cloud platform.