Apache Airflow Provider - Microsoft Azure

An Apache Airflow provider for Microsoft Azure services.

Version
4.2.0
Downloads
94,662/month
Last Published
Aug. 14, 2022
Quick Install

Available Modules

Modules are Python callables available from this provider package.

Types:

SensorsHooksOperatorsTransfersLogSecrets
WasbPrefixSensor
Microsoft Azure

Waits for blobs matching a prefix to arrive on Azure Blob Storage.

SensorsUpdated 14 days ago
WasbHook
Microsoft Azure

Interacts with Azure Blob Storage through the wasb:// protocol.

HooksUpdated 14 days ago
WasbBlobSensor
Microsoft Azure

Waits for a blob to arrive on Azure Blob Storage.

SensorsUpdated 14 days ago
WasbDeleteBlobOperator
Microsoft Azure

Deletes blob(s) on Azure Blob Storage.

OperatorsUpdated 14 days ago
LocalToAzureDataLakeStorageOperator
Microsoft Azure

Upload file(s) to Azure Data Lake

TransfersUpdated 14 days ago
AzureDataLakeStorageDeleteOperator
Microsoft Azure

Delete files in the specified path.

OperatorsUpdated 14 days ago
OracleToAzureDataLakeOperator
Microsoft Azure

Moves data from Oracle to Azure Data Lake. The operator runs the query against Oracle and stores the file locally before loading it into Azure Data La…

TransfersUpdated 14 days ago
AzureDataLakeStorageListOperator
Microsoft Azure

List all files from the specified path

OperatorsUpdated 14 days ago
AzureBlobStorageToGCSOperator
Microsoft Azure

Operator transfers data from Azure Blob Storage to specified bucket in Google Cloud Storage

TransfersUpdated 14 days ago
AzureBaseHook
Microsoft Azure

This hook acts as a base hook for azure services. It offers several authentication mechanisms to authenticate the client library used for upstream azu…

HooksUpdated 14 days ago
WasbTaskHandler
Microsoft Azure

FileTaskHandler is a python log handler that handles and reads task instance logs. It creates and delegates log handling to logging.FileHandler after …

LogUpdated 9 days ago
FileToWasbOperator
Microsoft Azure

Uploads a file to Azure Blob Storage.

TransfersUpdated a year ago
AzureDataExplorerHook
Microsoft Azure

Interacts with Azure Data Explorer (Kusto).

HooksUpdated 14 days ago
AzureDataExplorerQueryOperator
Microsoft Azure

Operator for querying Azure Data Explorer (Kusto).

OperatorsUpdated 14 days ago
AzureDataFactoryPipelineRunStatusSensor
Microsoft Azure

Checks the status of a pipeline run.

SensorsUpdated 14 days ago
AzureDataFactoryRunPipelineOperator
Microsoft Azure

Executes a data factory pipeline.

OperatorsUpdated 14 days ago
LocalFilesystemToWasbOperator
Microsoft Azure

Uploads a file to Azure Blob Storage.

TransfersUpdated 14 days ago
LocalFilesystemToADLSOperator
Microsoft Azure

Upload file(s) to Azure Data Lake

TransfersUpdated 14 days ago
AzureDataFactoryHook
Microsoft Azure

A hook to interact with Azure Data Factory.

HooksUpdated 8 days ago
AzureKeyVaultBackend
Microsoft Azure

Retrieves Airflow Connections or Variables from Azure Key Vault secrets.

SecretsUpdated 14 days ago
AzureFileShareHook
Microsoft Azure

Interacts with Azure FileShare Storage.

HooksUpdated 14 days ago
AzureDataLakeHook
Microsoft Azure

Interacts with Azure Data Lake.

HooksUpdated 14 days ago
AzureCosmosDocumentSensor
Microsoft Azure

Checks for the existence of a document which matches the given query in CosmosDB. Example:

SensorsUpdated 14 days ago
AzureCosmosInsertDocumentOperator
Microsoft Azure

Inserts a new document into the specified Cosmos database and collection It will create both the database and collection if they do not already exist

OperatorsUpdated 14 days ago
AzureCosmosDBHook
Microsoft Azure

Interacts with Azure CosmosDB.

HooksUpdated 14 days ago
AzureContainerRegistryHook
Microsoft Azure

A hook to communicate with a Azure Container Registry.

HooksUpdated 14 days ago
AzureContainerVolumeHook
Microsoft Azure

A hook which wraps an Azure Volume.

HooksUpdated 14 days ago
AzureContainerInstancesOperator
Microsoft Azure

Start a container on Azure Container Instances

OperatorsUpdated 14 days ago
AzureBatchOperator
Microsoft Azure

Executes a job on Azure Batch Service

OperatorsUpdated 14 days ago
AzureContainerInstanceHook
Microsoft Azure

A hook to communicate with Azure Container Instances.

HooksUpdated 14 days ago
AzureBatchHook
Microsoft Azure

Hook for Azure Batch APIs

HooksUpdated 14 days ago
SFTPToWasbOperator
Microsoft Azure

Transfer files to Azure Blob Storage from SFTP server.

TransfersUpdated 14 days ago
ADLSDeleteOperator
Microsoft Azure

Delete files in the specified path.

OperatorsUpdated 14 days ago
ADLSListOperator
Microsoft Azure

List all files from the specified path

OperatorsUpdated 14 days ago