DatahubKafkaHook

DataHub

Creates a DataHub Kafka connection used to send metadata to DataHub. Takes your kafka broker in the Kafka Broker(host) field.

View on GitHub

Last Updated: May. 17, 2021

Access Instructions

Install the DataHub provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

datahub_kafka_conn_idstrReference to the DataHub Kafka connection.

Documentation

Creates a DataHub Kafka connection used to send metadata to DataHub. Takes your kafka broker in the Kafka Broker(host) field.

URI example:

AIRFLOW_CONN_DATAHUB_KAFKA_DEFAULT='datahub-kafka://kafka-broker'

Was this page helpful?