PostgresToGCSOperator

Google

Copy data from Postgres to Google Cloud Storage in JSON or CSV format.

View Source

Last Updated: Nov. 10, 2020

Access Instructions

Install the Google provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

postgres_conn_idstrReference to a specific Postgres hook.
use_server_side_cursorboolIf server-side cursor should be used for querying postgres. For detailed info, check https://www.psycopg.org/docs/usage.html#server-side-cursors
cursor_itersizeintHow many records are fetched at a time in case of server-side cursor.

Documentation

Copy data from Postgres to Google Cloud Storage in JSON or CSV format.

Was this page helpful?