FTPToS3Operator

Amazon

This operator enables the transferring of files from FTP server to S3.

View on GitHub

Last Updated: May. 7, 2021

Access Instructions

Install the Amazon provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

s3_bucketstrThe targeted s3 bucket in which upload the file to
s3_keystrThe targeted s3 key. This is the specified file path for uploading the file to S3.
ftp_pathstrThe ftp remote path, including the file.
ftp_conn_idstrThe ftp connection id. The name or identifier for establishing a connection to the FTP server.
aws_conn_idstrThe s3 connection id. The name or identifier for establishing a connection to S3
replaceboolA flag to decide whether or not to overwrite the key if it already exists. If replace is False and the key exists, an error will be raised.
encryptboolIf True, the file will be encrypted on the server-side by S3 and will be stored in an encrypted form while at rest in S3.
gzipboolIf True, the file will be compressed locally
acl_policystrString specifying the canned ACL policy for the file being uploaded to the S3 bucket.

Documentation

This operator enables the transferring of files from FTP server to S3.

Was this page helpful?