Apache Airflow Provider - Microsoft Azure

Microsoft Azure

Core

An Apache Airflow provider for Microsoft Azure services.

Version
v3.2.0
Downloads
122,736/month
Last Published
Oct. 5, 2021
Quick Install

Available Modules

Modules are Python callables available from this provider package.

Types:

HooksSensorsOperatorsTransfersSecretsLog
AzureFileShareHook
Microsoft Azure

Interacts with Azure FileShare Storage.

HooksUpdated 4 months ago
WasbPrefixSensor
Microsoft Azure

Waits for blobs matching a prefix to arrive on Azure Blob Storage.

SensorsUpdated 5 days ago
WasbHook
Microsoft Azure

Interacts with Azure Blob Storage through the wasb:// protocol.

HooksUpdated a month ago
WasbBlobSensor
Microsoft Azure

Waits for a blob to arrive on Azure Blob Storage.

SensorsUpdated 5 days ago
WasbDeleteBlobOperator
Microsoft Azure

Deletes blob(s) on Azure Blob Storage.

OperatorsUpdated 5 days ago
LocalToAzureDataLakeStorageOperator
Microsoft Azure

This class is deprecated. Please use airflow.providers.microsoft.azure.transfers.local_to_adls.LocalFilesystemToADLSOperator.

TransfersUpdated a month ago
AzureDataLakeStorageDeleteOperator
Microsoft Azure

This class is deprecated. Please use airflow.providers.microsoft.azure.operators.adls.ADLSDeleteOperator.

OperatorsUpdated 24 days ago
OracleToAzureDataLakeOperator
Microsoft Azure

Moves data from Oracle to Azure Data Lake. The operator runs the query against Oracle and stores the file locally before loading it into Azure Data La…

TransfersUpdated 4 months ago
AzureDataFactoryHook
Microsoft Azure

A hook to interact with Azure Data Factory.

HooksUpdated a month ago
AzureDataLakeStorageListOperator
Microsoft Azure

This class is deprecated. Please use airflow.providers.microsoft.azure.operators.adls.ADLSListOperator.

OperatorsUpdated 24 days ago
AzureCosmosDBHook
Microsoft Azure

Interacts with Azure CosmosDB.

HooksUpdated 15 days ago
AzureKeyVaultBackend
Microsoft Azure

Retrieves Airflow Connections or Variables from Azure Key Vault secrets.

SecretsUpdated 16 days ago
AzureContainerVolumeHook
Microsoft Azure

A hook which wraps an Azure Volume.

HooksUpdated 4 months ago
AzureContainerRegistryHook
Microsoft Azure

A hook to communicate with a Azure Container Registry.

HooksUpdated 6 months ago
AzureContainerInstancesOperator
Microsoft Azure

Start a container on Azure Container Instances

OperatorsUpdated 4 months ago
AzureDataLakeHook
Microsoft Azure

Interacts with Azure Data Lake.

HooksUpdated 6 months ago
AzureBlobStorageToGCSOperator
Microsoft Azure

Operator transfers data from Azure Blob Storage to specified bucket in Google Cloud Storage

TransfersUpdated 5 months ago
AzureBatchOperator
Microsoft Azure

Executes a job on Azure Batch Service

OperatorsUpdated 2 days ago
AzureBaseHook
Microsoft Azure

This hook acts as a base hook for azure services. It offers several authentication mechanisms to authenticate the client library used for upstream azu…

HooksUpdated 6 months ago
AzureBatchHook
Microsoft Azure

Hook for Azure Batch APIs

HooksUpdated a month ago
WasbTaskHandler
Microsoft Azure

WasbTaskHandler is a python log handler that handles and reads task instance logs. It extends airflow FileTaskHandler and uploads to and reads from Wa…

LogUpdated 4 months ago
FileToWasbOperator
Microsoft Azure

Uploads a file to Azure Blob Storage.

TransfersUpdated a month ago
AzureContainerInstanceHook
Microsoft Azure

A hook to communicate with Azure Container Instances.

HooksUpdated 2 months ago
AzureDataExplorerHook
Microsoft Azure

Interacts with Azure Data Explorer (Kusto).

HooksUpdated 24 days ago
AzureDataExplorerQueryOperator
Microsoft Azure

Operator for querying Azure Data Explorer (Kusto).

OperatorsUpdated 5 months ago
AzureCosmosDocumentSensor
Microsoft Azure

Checks for the existence of a document which matches the given query in CosmosDB. Example:

SensorsUpdated 5 months ago
AzureCosmosInsertDocumentOperator
Microsoft Azure

Inserts a new document into the specified Cosmos database and collection It will create both the database and collection if they do not already exist

OperatorsUpdated 5 months ago
AzureDataFactoryPipelineRunStatusSensor
Microsoft Azure

Checks the status of a pipeline run.

SensorsUpdated a month ago
ADLSDeleteOperator
Microsoft Azure

Delete files in the specified path.

OperatorsUpdated 24 days ago
AzureDataFactoryRunPipelineOperator
Microsoft Azure

Executes a data factory pipeline.

OperatorsUpdated a month ago
LocalFilesystemToWasbOperator
Microsoft Azure

Uploads a file to Azure Blob Storage.

TransfersUpdated a month ago
ADLSListOperator
Microsoft Azure

List all files from the specified path

OperatorsUpdated 24 days ago
LocalFilesystemToADLSOperator
Microsoft Azure

Upload file(s) to Azure Data Lake

TransfersUpdated a month ago
AzureDataFactoryHook
Microsoft Azure

A hook to interact with Azure Data Factory.

HooksUpdated a month ago