CloudwatchTaskHandler

Amazon

CloudwatchTaskHandler is a python log handler that handles and reads task instance logs.

View Source

Last Updated: May. 1, 2021

Access Instructions

Install the Amazon provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

base_log_folderstrbase folder to store logs locally
log_group_arnstrARN of the Cloudwatch log group for remote log storage with format arn:aws:logs:{region name}:{account id}:log-group:{group name}
filename_templatestrtemplate for file name (local storage) or log stream name (remote)

Documentation

CloudwatchTaskHandler is a python log handler that handles and reads task instance logs.

It extends airflow FileTaskHandler and uploads to and reads from Cloudwatch.

Example DAGs

Improve this module by creating an example DAG.

View Source
  1. Add an `example_dags` directory to the top-level source of the provider package with an empty `__init__.py` file.
  2. Add your DAG to this directory. Be sure to include a well-written and descriptive docstring
  3. Create a pull request against the source code. Once the package gets released, your DAG will show up on the Registry.

Was this page helpful?