SageMakerTransformOperator

Amazon

Initiate a SageMaker transform job.

View Source

Last Updated: May. 7, 2021

Access Instructions

Install the Amazon provider package into your Airflow environment.

Import the module into your DAG file and instantiate it with your desired params.

Parameters

configdictThe configuration necessary to start a transform job (templated).If you need to create a SageMaker transform job based on an existed SageMaker model:config = transform_configIf you need to create both SageMaker model and SageMaker Transform job:config = { 'Model': model_config, 'Transform': transform_config }For details of the configuration parameter of transform_config see :py:meth:`SageMaker.Client.create_transform_job`No role entry for "py:meth" in module "docutils.parsers.rst.languages.en". Trying "py:meth" as canonical role name.Unknown interpreted text role "py:meth".For details of the configuration parameter of model_config, See: :py:meth:`SageMaker.Client.create_model`No role entry for "py:meth" in module "docutils.parsers.rst.languages.en". Trying "py:meth" as canonical role name.Unknown interpreted text role "py:meth".
aws_conn_idstrThe AWS connection ID to use.
wait_for_completionboolSet to True to wait until the transform job finishes.
check_intervalintIf wait is set to True, the time interval, in seconds, that this operation waits to check the status of the transform job.
max_ingestion_timeintIf wait is set to True, the operation fails if the transform job doesn't finish within max_ingestion_time seconds. If you set this parameter to None, the operation does not timeout.

Documentation

Initiate a SageMaker transform job.

This operator returns The ARN of the model created in Amazon SageMaker.

Example DAGs

Improve this module by creating an example DAG.

View Source
  1. Add an `example_dags` directory to the top-level source of the provider package with an empty `__init__.py` file.
  2. Add your DAG to this directory. Be sure to include a well-written and descriptive docstring
  3. Create a pull request against the source code. Once the package gets released, your DAG will show up on the Registry.

Was this page helpful?