An Apache Airflow provider for Hightouch
Apache Airflow Provider for Hightouch
Provides an Airflow Operator and Hook for Hightouch. This allows the user to initiate a run for a sync from Airflow.
Pre-requisites: An environment running
apache-airflow >= 1.10, including >= 2.
pip install airflow-provider-hightouch
In the Airflow Connections UI, create a new connection for Hightouch.
Password: enter the API key for your workspace. You can generate an API
key from your Workspace Settings
The Operator uses the
hightouch_default connection id by default, but
if needed, you can create additional Airflow Connections and reference them
in the operator
Starts a Hightouch Sync Run. Requires the
sync_id for the sync you wish to
run. You can find the
sync_id in the browser url:
The run is asynchronous, and the task will be marked complete if the request was successfully sent to the Hightouch API.
If the API key is not authorized or if the request is invalid the task will fail. If a run is already in progress, a new run will be triggered following the completion of the existing run.
Creating a run is as simple as importing the operator and providing it with a sync_id. An example dag is available as well.
from airflow_provider_hightouch.operators.hightouch import HightouchTriggerSyncOperatorwith DAG(....) as dag:...my_task = HightouchTriggerSyncOperator(task_id="run_my_sync", sync_id=1)
Please submit issues and pull requests in our official repo: https://github.com/hightouchio/airflow-provider-hightouch
We are happy to hear from you, for any feedback please email the authors at email@example.com.