WebHDFSHook

HDFS

Interact with HDFS. This class is a wrapper around the hdfscli library.

View on GitHub

Last Updated: Dec. 8, 2020

Access Instructions

Install the HDFS provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

webhdfs_conn_idstrThe connection id for the webhdfs client to connect to.
proxy_userstrThe user used to authenticate.

Documentation

Interact with HDFS. This class is a wrapper around the hdfscli library.

Was this page helpful?