Control-M for GCP Data Fusion

Google Cloud Platform (GCP) Data Fusion is an extract, transform, and load (ETL) service that enables you to load data from multiple sources, visualize it, and publish it to the cloud.

Control-M for GCP Data Fusion enables you to do the following:

  • Execute single or Workflow Template GCP Data Fusion pipelines, abort a pipeline, and get third-party job logs.

  • Manage GCP Data Fusion credentials in a secure connection profile.

  • Connect to any GCP Data Fusion endpoint.

  • Introduce all Control-M capabilities to Control-M for GCP Data Fusion, including advanced scheduling criteria, complex dependencies, Resource Pools, Lock Resources, and variables.

  • Integrate GCP Data Fusion pipelines with other Control-M jobs into a single scheduling environment.

  • Monitor the status, results, and output of GCP Data Fusion pipelines.

  • Attach an SLA job to the GCP Data Fusion jobs.

  • Run 50 GCP Data Fusion jobs simultaneously per Agent.

Control-M for GCP Data Fusion Compatibility

The following table lists the prerequisites that are required to use the GCP Data Fusion plug-in, each with its minimum required version.

Component

Version

Control-M/EM

9.0.21.100

Control-M/Agent

9.0.21.100

Control-M Application Integrator

9.0.21.100

Control-M Automation API

9.0.21.125

Control-M for GCP Data Fusion is supported on Control-M Web and Control-M Automation API, but not on the Control-M client.

To download the required installation files for each prerequisite, see Obtaining Control-M Installation Files.

Setting up Control-M for GCP Data Fusion

This procedure describes how to deploy the GCP Data Fusion plug-in, create a connection profile, and define a GCP Data Fusion job in Control-M Web and Automation API.

Integration plug-ins released by BMC require an Application Integrator installation. However, these plug-ins are not editable and you cannot import them into Application Integrator. To deploy these integrations to your Control-M environment, import them directly into Control-M with Control-M Automation API.

Before You Begin

Verify that Automation API is installed, as described in Automation API Installation.

Begin

  1. Create a temporary directory to save the downloaded files.

  2. Download the GCP Data Fusion plug-in from the Control-M for GCP Data Fusion download page in the EPD site.

  3. Install the GCP Data Fusion plug-in with the Automation API Provision service:

    1. Log in to the Control-M/EM Server machine as an Administrator and store the downloaded zip file in the one of the following locations:

      • Linux: $HOME/ctm_em/AUTO_DEPLOY

      • Windows: <EM_HOME>\AUTO_DEPLOY

    2. Log in to the Control-M/Agent machine and run the provision image command, as follows:

      • Linux: ctm provision image GCP_Data_Fusion_plugin.Linux

      • Windows: ctm provision image GCP_Data_Fusion_plugin.Windows

  4. Create a GCP Data Fusion connection profile in Control-M Web or Automation API, as follows:

  5. Define a GCP Data Fusion job in Control-M Web or Automation API, as follows:

To remove this plug-in from an Agent, see Removing a Plug-in. The plug-in ID is GDU102023.

Change Log

The following table provides details about changes that were introduced in new versions of this plug-in:

Plug-in Version

Details

1.0.00

Initial version