Control-M for Airflow
Control-M for Airflow is a plug-in that enables you to do the following:
-
Monitor and manage DAG workflows within Control-M, including viewing the specific details of each task.
-
Connect to any Airflow endpoint from a single computer with secure login, which eliminates the need to provide authentication.
-
Integrate Airflow jobs with other Control-M jobs into a single scheduling environment.
-
Attach an SLA job to your Airflow jobs.
-
Introduce all Control-M capabilities to Control-M for Airflow, including advanced scheduling criteria, complex dependencies, Resource Pools, Lock Resources, and variables.
Compatibility
The following table lists the Control-M for Airflow plug-in prerequisites, each with its minimum required version.
Prerequisites |
Version |
---|---|
Control-M/EM |
9.0.21 |
Control-M/Server |
9.0.20.200 or higher |
Control-M/Agent |
9.0.21 |
Standalone Airflow Server |
2.2–2.x |
Google Cloud Composer Service Account Prerequisites:
|
1.17.9–1.x 2–2.x |
Setting Up Control-M for Airflow
This procedure describes how to install the Airflow plug-in, create a connection profile, and define an Airflow job in Control-M Web and in Automation API.
Begin
-
Create a temporary directory to save the downloaded files.
-
Download the Control-M for Airflow plug-in.
-
Install Control-M for Airflow, as described in Control-M for Airflow Installation.
-
Create an Airflow connection profile, as follows:
-
Control-M: Create a Centralized Connection Profile with Airflow Connection Profile Parameters.
-
Automation API: ConnectionProfile:Airflow.
-
-
Define an Airflow job, as follows:
-
Control-M: Create a job and then define specific Airflow job definitions with Airflow Job attributes.
-
Automation API: Job:Airflow.
-