DatabricksHook

Databricks

Interact with Databricks.

View Source

Last Updated: Apr. 16, 2021

Access Instructions

Install the Databricks provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

databricks_conn_idstrThe name of the databricks connection to use.
timeout_secondsintThe amount of time in seconds the requests library will wait before timing-out.
retry_limitintThe number of times to retry the connection in case of service outages.
retry_delayfloatThe number of seconds to wait between retries (it might be a floating point number).

Documentation

Interact with Databricks.

Example DAGs

Improve this module by creating an example DAG.

View Source
  1. Add an `example_dags` directory to the top-level source of the provider package with an empty `__init__.py` file.
  2. Add your DAG to this directory. Be sure to include a well-written and descriptive docstring
  3. Create a pull request against the source code. Once the package gets released, your DAG will show up on the Registry.

Was this page helpful?