Control-M for Amazon MWAA

Amazon Managed Workflows for Apache Airflow (MWAA) enables you to create, schedule, and monitor data pipelines and workflows.

Control-M for Amazon MWAA enables you to do the following:

• Manage Amazon MWAA credentials in a secure connection profile.

• Connect to any Amazon MWAA endpoint.

• Introduce all Control-M capabilities to Control-M for Amazon MWAA, including advanced scheduling criteria, complex dependencies, resource pools, lock resources, and variables.

• Integrate Amazon MWAA jobs with other Control-M jobs into a single scheduling environment.

• Monitor the status, results, and output of Amazon MWAA jobs.

• Attach an SLA job to the Amazon MWAA jobs.

• Run 50 Amazon MWAA jobs simultaneously per Agent.

Setting up Control-M for Amazon MWAA

This procedure describes how to deploy the Amazon MWAA plug-in, create a connection profile, and define an Amazon MWAA job in Control-M SaaS and Automation API.

Before You Begin

• Verify that Java is installed, as described in Control-M External Java Installation.

• Verify that Automation API is installed, as described in Setting Up the API.

• Verify that Agent version 9.0.21.080 or higher is installed.

Begin

1. Run one of the following provision image commands:

   • Linux: ctm provision image AWS_MWAA_plugin.Linux

   • Windows: ctm provision image AWS_MWAA_plugin.Windows

2. Create an Amazon MWAA connection profile in Control-M SaaS or Automation API, as follows:

   • Control-M SaaS: Create a Centralized Connection Profile with Amazon MWAA Connection Profile Parameters

   • Automation API: ConnectionProfile:AWS MWAA

3. Define an Amazon MWAA job in Control-M SaaS or Automation API, as follows:

   • Control-M SaaS: Create a Job with Amazon MWAA Job parameters

   • Automation API: Job:AWS MWAA

Change Log

The following table provides details about changes that were introduced in new versions of this plug-in:

Plug-in Version	Details
1.0.04	Added support for Airflow 3 (REST V 2) Added support for Federated OIDC Authentication and several connection profile parameters associated with the new authentication method. Added several parameters to job definition Added the ability to capture Task Instance logs to the job output Increased the maximum recommended output size to 10 Added the Skipped failure status Changed default value of the Switch to Rerun and Keep Run ID parameters to Never
1.0.03	Fixed Authentication Method display name
1.0.02	Added AWS Assume IAM Role cross-account authentication
1.0.01	Added Rerun DAG action
1.0.00	Initial version