Apache Pig
»

PigOperator

View on GitHub

Created by

Airflow Community

Last Updated

Version

4.7.3

Executes pig script.

Parameters

pig

strREQUIRED

the pig latin script to be executed. (templated)

pig_cli_conn_id

str

reference to the Hive database

pigparams_jinja_translate

bool

when True, pig params-type templating ${var} gets translated into jinja-type templating {{ var }}. Note that you may want to use this along with the DAG(user_defined_macros=myargs) parameter. View the DAG object documentation for more details.

pig_opts

str | None

pig options, such as: -x tez, -useHCatalog, … - space separated list

pig_properties

list[str] | None

pig properties, additional pig properties passed as list

Documentation

Executes pig script.