ADLSListOperator

Microsoft Azure

List all files from the specified path

View on GitHub

Last Updated: Nov. 14, 2021

Access Instructions

Install the Microsoft Azure provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

pathRequiredstrThe Azure Data Lake path to find the objects. Supports glob strings (templated)
azure_data_lake_conn_idstrReference to the Azure Data Lake connection.

Documentation

List all files from the specified path

param path

The Azure Data Lake path to find the objects. Supports glob strings (templated)

type path

str

param azure_data_lake_conn_id

Reference to the Azure Data Lake connection.

type azure_data_lake_conn_id

str

Example:

The following Operator would list all the Parquet files from folder/output/ folder in the specified ADLS account

adls_files = ADLSListOperator(
task_id='adls_files',
path='folder/output/*.parquet',
azure_data_lake_conn_id='azure_data_lake_default'
)

Was this page helpful?