Control-M for Airflow

Control-M for Airflow is a plug-in that enables you to do the following:

  • Monitor and manage DAG workflows within Control-M, including viewing the specific details of each task.

  • Connect to any Airflow endpoint from a single computer with secure login, which eliminates the need to provide authentication.

  • Integrate Airflow jobs with other Control-M jobs into a single scheduling environment.

  • Attach an SLA job to your Airflow jobs.

  • Introduce all Control-M capabilities to Control-M for Airflow, including advanced scheduling criteria, complex dependencies, Resource Pools, Lock Resources, and variables.

Compatibility

The following table lists the Control-M for Airflow plug-in prerequisites, each with its minimum required version.

Prerequisites

Version

Control-M/EM

9.0.21

Control-M/Server

9.0.20.200 or higher

Control-M/Agent

9.0.21

Standalone Airflow Server

2.2–2.x

Google Cloud Composer

Service Account Prerequisites:

  • The email address for this account must be less than 64 characters.

  • The Composer User (composer.user) role must be assigned to this account in Google Cloud.

1.17.9–1.x

2–2.x

Setting Up Control-M for Airflow

This procedure describes how to install the Airflow plug-in, create a connection profile, and define an Airflow job in Control-M Web and in Automation API.

Begin

  1. Create a temporary directory to save the downloaded files.

  2. Download the Control-M for Airflow plug-in.

  3. Install Control-M for Airflow, as described in Control-M for Airflow Installation.

  4. Create an Airflow connection profile, as follows:

  5. Define an Airflow job, as follows: