EMRContainerSensor

Amazon

Asks for the state of the job run until it reaches a failure state or success state. If the job run fails, the task will fail.

View on GitHub

Last Updated: Aug. 27, 2021

Access Instructions

Install the Amazon provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

job_idRequiredstrjob_id to check the state of
max_retriesintNumber of times to poll for query state before returning the current state, defaults to None
aws_conn_idstraws connection to use, defaults to ‘aws_default’
poll_intervalintTime in seconds to wait between two consecutive call to check query status on athena, defaults to 10

Documentation

Asks for the state of the job run until it reaches a failure state or success state. If the job run fails, the task will fail.

Was this page helpful?