Apache Airflow Provider - Apache Airflow

Apache Airflow

CoreCertified

While not an explicit provider package, Apache Airflow contains a set of native modules that are closely-coupled to the project codebase. Many providers extend these core modules to add additional, more specialized functionality.

Version
v2.0.2
Downloads
1,751,585/month
Last Published
Apr. 19, 2021
Quick Install

Available Modules

Modules are Python callables available from this provider package.

Types:

HooksOperatorsSensorsSecrets
DiscoverableHook
Apache Airflow

Interface that providers can implement to be discovered by ProvidersManager.

HooksUpdated 2 days ago
DbApiHook
Apache Airflow

Abstract base class for sql hooks.

HooksUpdated 25 days ago
BashOperator
Apache Airflow

Execute a Bash script, command or set of commands.

OperatorsUpdated 10 days ago
SQLCheckOperator
Apache Airflow

Performs checks against a db. The SQLCheckOperator expects a sql query that will return a single row. Each value on that first row is evaluated using …

OperatorsUpdated a month ago
SQLIntervalCheckOperator
Apache Airflow

Checks that the values of metrics given as SQL expressions are within a certain tolerance of the ones from days_back before.

OperatorsUpdated a month ago
SQLThresholdCheckOperator
Apache Airflow

Performs a value check using sql code against a minimum threshold and a maximum threshold. Thresholds can be in the form of a numeric value OR a sql s…

OperatorsUpdated a month ago
SQLValueCheckOperator
Apache Airflow

Performs a simple value check using sql code.

OperatorsUpdated a month ago
TriggerDagRunOperator
Apache Airflow

Triggers a DAG run for a specified dag_id

OperatorsUpdated a month ago
DummyOperator
Apache Airflow

Operator that does literally nothing. It can be used to group tasks in a DAG.

OperatorsUpdated 5 months ago
EmailOperator
Apache Airflow

Sends an email.

OperatorsUpdated 3 months ago
LatestOnlyOperator
Apache Airflow

Allows a workflow to skip tasks that are not running during the most recent schedule interval.

OperatorsUpdated 5 months ago
BranchPythonOperator
Apache Airflow

Allows a workflow to “branch” or follow a path following the execution of this task.

OperatorsUpdated 18 hours ago
PythonOperator
Apache Airflow

Executes a Python callable

OperatorsUpdated 18 hours ago
PythonVirtualenvOperator
Apache Airflow

Allows one to run a function in a virtualenv that is created and destroyed automatically (with certain caveats).

OperatorsUpdated 18 hours ago
ShortCircuitOperator
Apache Airflow

Allows a workflow to continue only if a condition is met. Otherwise, the workflow “short-circuits” and downstream tasks are skipped.

OperatorsUpdated 18 hours ago
_PythonDecoratedOperator
Apache Airflow

Wraps a Python callable and captures args/kwargs when called for execution.

OperatorsUpdated 18 hours ago
BranchSQLOperator
Apache Airflow

Executes sql code in a specific database

OperatorsUpdated a month ago
BaseSensorOperator
Apache Airflow

Sensor operators are derived from this class and inherit these attributes.

SensorsUpdated 5 months ago
SubDagOperator
Apache Airflow

This runs a sub dag. By convention, a sub dag’s dag_id should be prefixed by its parent and a dot. As in parent.child. Although SubDagOperator can occ…

OperatorsUpdated 5 months ago
BaseSecretsBackend
Apache Airflow

Abstract base class to retrieve Connection object given a conn_id or Variable given a key

SecretsUpdated 5 months ago
EnvironmentVariablesBackend
Apache Airflow

Retrieves Connection object and Variable from environment variable.

SecretsUpdated 5 months ago
LocalFilesystemBackend
Apache Airflow

Retrieves Connection objects and Variables from local files

SecretsUpdated 2 months ago
MetastoreBackend
Apache Airflow

Retrieves Connection object and Variable from airflow metastore database.

SecretsUpdated 5 months ago
BashSensor
Apache Airflow

Executes a bash command/script and returns True if and only if the return code is 0.

SensorsUpdated 10 days ago
DateTimeSensor
Apache Airflow

Waits until the specified datetime.

SensorsUpdated 3 months ago
PythonSensor
Apache Airflow

Waits for a Python callable to return True.

SensorsUpdated 5 months ago
SensorWork
Apache Airflow

This class stores a sensor work with decoded context value. It is only used inside of smart sensor. Create a sensor work based on sensor instance reco…

SensorsUpdated 2 days ago
SmartSensorOperator
Apache Airflow

Smart sensor operators are derived from this class.

SensorsUpdated 2 days ago
TimeDeltaSensor
Apache Airflow

Waits for a timedelta after the task’s execution_date + schedule_interval. In Airflow, the daily task stamped with execution_date 2016-01-01 can only …

SensorsUpdated 5 months ago
TimeSensor
Apache Airflow

Waits until the specified time of the day.

SensorsUpdated 5 months ago
DayOfWeekSensor
Apache Airflow

Waits until the first specified day of the week. For example, if the execution day of the task is ‘2018-12-22’ (Saturday) and you pass ‘FRIDAY’, the t…

SensorsUpdated 5 months ago
BaseHook
Apache Airflow

Abstract base class for hooks, hooks are meant as an interface to interact with external systems. MySqlHook, HiveHook, PigHook return object that can …

HooksUpdated 2 days ago
ExternalTaskSensor
Apache Airflow

Waits for a different DAG or a task in a different DAG to complete for a specific execution_date

SensorsUpdated 5 months ago
FSHook
Apache Airflow

Allows for interaction with an file server.

HooksUpdated 5 months ago
BaseBranchOperator
Apache Airflow

This is a base class for creating operators with branching functionality, similarly to BranchPythonOperator.

OperatorsUpdated 4 months ago
WebHDFSHook
Apache Airflow

Interact with HDFS. This class is a wrapper around the hdfscli library.

HooksUpdated 25 days ago