PigOperator

Pig

Executes pig script.

View Source

Last Updated: May. 7, 2021

Access Instructions

Install the Pig provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

pigstrthe pig latin script to be executed. (templated)
pig_cli_conn_idstrreference to the Hive database
pigparams_jinja_translateboolwhen True, pig params-type templating ${var} gets translated into jinja-type templating {{ var }}. Note that you may want to use this along with the DAG(user_defined_macros=myargs) parameter. View the DAG object documentation for more details.
pig_optsstrpig options, such as: -x tez, -useHCatalog, ...

Documentation

Executes pig script.

Was this page helpful?