DataprocCreatePysparkJobOperator

Yandex

Runs Pyspark job in Data Proc cluster.

View Source

Last Updated: Mar. 26, 2021

Access Instructions

Install the Yandex provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Documentation

Runs Pyspark job in Data Proc cluster.

Was this page helpful?