Microsoft Azure
An Apache Airflow provider for Microsoft Azure services.
Quick Install
Available Modules
Modules are Python callables available from this provider package.
Types:
HooksSensorsOperatorsTransfersSecretsLogInteracts with Azure FileShare Storage.
Waits for blobs matching a prefix to arrive on Azure Blob Storage.
Interacts with Azure Blob Storage through the wasb:// protocol.
Waits for a blob to arrive on Azure Blob Storage.
Deletes blob(s) on Azure Blob Storage.
This class is deprecated. Please use airflow.providers.microsoft.azure.transfers.local_to_adls.LocalFilesystemToADLSOperator.
This class is deprecated. Please use airflow.providers.microsoft.azure.operators.adls.ADLSDeleteOperator.
Moves data from Oracle to Azure Data Lake. The operator runs the query against Oracle and stores the file locally before loading it into Azure Data La…
A hook to interact with Azure Data Factory.
This class is deprecated. Please use airflow.providers.microsoft.azure.operators.adls.ADLSListOperator.
Interacts with Azure CosmosDB.
Retrieves Airflow Connections or Variables from Azure Key Vault secrets.
A hook which wraps an Azure Volume.
A hook to communicate with a Azure Container Registry.
Start a container on Azure Container Instances
Interacts with Azure Data Lake.
Operator transfers data from Azure Blob Storage to specified bucket in Google Cloud Storage
Executes a job on Azure Batch Service
This hook acts as a base hook for azure services. It offers several authentication mechanisms to authenticate the client library used for upstream azu…
Hook for Azure Batch APIs
WasbTaskHandler is a python log handler that handles and reads task instance logs. It extends airflow FileTaskHandler and uploads to and reads from Wa…
Uploads a file to Azure Blob Storage.
A hook to communicate with Azure Container Instances.
Interacts with Azure Data Explorer (Kusto).
Operator for querying Azure Data Explorer (Kusto).
Checks for the existence of a document which matches the given query in CosmosDB. Example:
Inserts a new document into the specified Cosmos database and collection It will create both the database and collection if they do not already exist
Checks the status of a pipeline run.
Delete files in the specified path.
Executes a data factory pipeline.
Uploads a file to Azure Blob Storage.
List all files from the specified path
Upload file(s) to Azure Data Lake
A hook to interact with Azure Data Factory.