GlueCrawlerSensor

Amazon

Waits for an AWS Glue crawler to reach any of the statuses below ‘FAILED’, ‘CANCELLED’, ‘SUCCEEDED’

View on GitHub

Last Updated: Mar. 21, 2022

Access Instructions

Install the Amazon provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

crawler_nameRequiredThe AWS Glue crawler unique name
aws_conn_idaws connection to use, defaults to ‘aws_default’

Documentation

Waits for an AWS Glue crawler to reach any of the statuses below ‘FAILED’, ‘CANCELLED’, ‘SUCCEEDED’

See also

For more information on how to use this sensor, take a look at the guide: Wait on an AWS Glue crawler state

Was this page helpful?