Apache Airflow Provider - Microsoft Azure

An Apache Airflow provider for Microsoft Azure services.

Version
v3.4.0
Downloads
75,303/month
Last Published
Dec. 6, 2021
Quick Install

Available Modules

Modules are Python callables available from this provider package.

Types:

HooksSensorsOperatorsTransfersSecretsLog
AzureFileShareHook
Microsoft Azure

Interacts with Azure FileShare Storage.

HooksUpdated 22 days ago
WasbPrefixSensor
Microsoft Azure

Waits for blobs matching a prefix to arrive on Azure Blob Storage.

SensorsUpdated 2 months ago
WasbHook
Microsoft Azure

Interacts with Azure Blob Storage through the wasb:// protocol.

HooksUpdated a day ago
WasbBlobSensor
Microsoft Azure

Waits for a blob to arrive on Azure Blob Storage.

SensorsUpdated 2 months ago
WasbDeleteBlobOperator
Microsoft Azure

Deletes blob(s) on Azure Blob Storage.

OperatorsUpdated 2 months ago
LocalToAzureDataLakeStorageOperator
Microsoft Azure

This class is deprecated. Please use airflow.providers.microsoft.azure.transfers.local_to_adls.LocalFilesystemToADLSOperator.

TransfersUpdated 22 days ago
AzureDataLakeStorageDeleteOperator
Microsoft Azure

This class is deprecated. Please use airflow.providers.microsoft.azure.operators.adls.ADLSDeleteOperator.

OperatorsUpdated 2 months ago
OracleToAzureDataLakeOperator
Microsoft Azure

Moves data from Oracle to Azure Data Lake. The operator runs the query against Oracle and stores the file locally before loading it into Azure Data La…

TransfersUpdated 22 days ago
AzureDataFactoryHook
Microsoft Azure

A hook to interact with Azure Data Factory.

HooksUpdated 3 months ago
AzureDataLakeStorageListOperator
Microsoft Azure

This class is deprecated. Please use airflow.providers.microsoft.azure.operators.adls.ADLSListOperator.

OperatorsUpdated 2 months ago
AzureCosmosDBHook
Microsoft Azure

Interacts with Azure CosmosDB.

HooksUpdated 22 days ago
AzureKeyVaultBackend
Microsoft Azure

Retrieves Airflow Connections or Variables from Azure Key Vault secrets.

SecretsUpdated 22 days ago
AzureContainerVolumeHook
Microsoft Azure

A hook which wraps an Azure Volume.

HooksUpdated 22 days ago
AzureContainerRegistryHook
Microsoft Azure

A hook to communicate with a Azure Container Registry.

HooksUpdated 22 days ago
AzureContainerInstancesOperator
Microsoft Azure

Start a container on Azure Container Instances

OperatorsUpdated 22 days ago
AzureDataLakeHook
Microsoft Azure

Interacts with Azure Data Lake.

HooksUpdated 22 days ago
AzureBlobStorageToGCSOperator
Microsoft Azure

Operator transfers data from Azure Blob Storage to specified bucket in Google Cloud Storage

TransfersUpdated 7 months ago
AzureBatchOperator
Microsoft Azure

Executes a job on Azure Batch Service

OperatorsUpdated 22 days ago
AzureBaseHook
Microsoft Azure

This hook acts as a base hook for azure services. It offers several authentication mechanisms to authenticate the client library used for upstream azu…

HooksUpdated 7 months ago
AzureBatchHook
Microsoft Azure

Hook for Azure Batch APIs

HooksUpdated 22 days ago
WasbTaskHandler
Microsoft Azure

WasbTaskHandler is a python log handler that handles and reads task instance logs. It extends airflow FileTaskHandler and uploads to and reads from Wa…

LogUpdated a day ago
FileToWasbOperator
Microsoft Azure

Uploads a file to Azure Blob Storage.

TransfersUpdated 3 months ago
AzureContainerInstanceHook
Microsoft Azure

A hook to communicate with Azure Container Instances.

HooksUpdated 22 days ago
AzureDataExplorerHook
Microsoft Azure

Interacts with Azure Data Explorer (Kusto).

HooksUpdated 2 months ago
AzureDataExplorerQueryOperator
Microsoft Azure

Operator for querying Azure Data Explorer (Kusto).

OperatorsUpdated 7 months ago
AzureCosmosDocumentSensor
Microsoft Azure

Checks for the existence of a document which matches the given query in CosmosDB. Example:

SensorsUpdated 22 days ago
AzureCosmosInsertDocumentOperator
Microsoft Azure

Inserts a new document into the specified Cosmos database and collection It will create both the database and collection if they do not already exist

OperatorsUpdated 22 days ago
AzureDataFactoryPipelineRunStatusSensor
Microsoft Azure

Checks the status of a pipeline run.

SensorsUpdated 3 months ago
ADLSDeleteOperator
Microsoft Azure

Delete files in the specified path.

OperatorsUpdated 22 days ago
AzureDataFactoryRunPipelineOperator
Microsoft Azure

Executes a data factory pipeline.

OperatorsUpdated a day ago
LocalFilesystemToWasbOperator
Microsoft Azure

Uploads a file to Azure Blob Storage.

TransfersUpdated 3 months ago
ADLSListOperator
Microsoft Azure

List all files from the specified path

OperatorsUpdated 22 days ago
LocalFilesystemToADLSOperator
Microsoft Azure

Upload file(s) to Azure Data Lake

TransfersUpdated 22 days ago
AzureDataFactoryHook
Microsoft Azure

A hook to interact with Azure Data Factory.

HooksUpdated 5 hours ago