QuboleOperator

Qubole

Execute tasks (commands) on QDS (https://qubole.com).

View Source

Last Updated: May. 7, 2021

Access Instructions

Install the Qubole provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

qubole_conn_idstrConnection id which consists of qds auth_token

Documentation

Execute tasks (commands) on QDS (https://qubole.com).

kwargs:

Arguments specific to command types

hivecmd:
prestocmd:
hadoopcmd:
shellcmd:
pigcmd:
sparkcmd:
dbtapquerycmd:
dbexportcmd:
dbimportcmd:
jupytercmd:

Example DAGs

Was this page helpful?