QuboleValueCheckOperator

Qubole

Performs a simple value check using Qubole command. By default, each value on the first row of this Qubole command is compared with a pre-defined value. The check fails and errors out if the output of the command is not within the permissible limit of expected value.

View Source

Last Updated: May. 7, 2021

Access Instructions

Install the Qubole provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

qubole_conn_idstrConnection id which consists of qds auth_token
pass_valuestr or int or floatExpected value of the query results.
toleranceint or floatDefines the permissible pass_value range, for example if tolerance is 2, the Qubole command output can be anything between -2*pass_value and 2*pass_value, without the operator erring out.

Documentation

Performs a simple value check using Qubole command. By default, each value on the first row of this Qubole command is compared with a pre-defined value. The check fails and errors out if the output of the command is not within the permissible limit of expected value.

kwargs:

Arguments specific to Qubole command can be referred from QuboleOperator docs.

Note

All fields in common with template fields of QuboleOperator and SQLValueCheckOperator are template-supported.

Example DAGs

Improve this module by creating an example DAG.

View Source
  1. Add an `example_dags` directory to the top-level source of the provider package with an empty `__init__.py` file.
  2. Add your DAG to this directory. Be sure to include a well-written and descriptive docstring
  3. Create a pull request against the source code. Once the package gets released, your DAG will show up on the Registry.

Was this page helpful?