EmrStepSensor

Amazon

Asks for the state of the step until it reaches any of the target states. If it fails the sensor errors, failing the task.

View Source

Last Updated: May. 7, 2021

Access Instructions

Install the Amazon provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

job_flow_idstrjob_flow_id which contains the step check the state of
step_idstrstep to check the state of
target_stateslist[str]the target states, sensor waits until step reaches any of these states
failed_stateslist[str]the failure states, sensor fails when step reaches any of these states

Documentation

Asks for the state of the step until it reaches any of the target states. If it fails the sensor errors, failing the task.

With the default target states, sensor waits step to be completed.

Was this page helpful?