Control-M for GCP Data Fusion

Google Cloud Platform (GCP) Data Fusion is an extract, transform, and load (ETL) service that enables you to load data from multiple sources, visualize it, and publish it to the cloud.

Control-M for GCP Data Fusion enables you to do the following:

• Execute single or Workflow Template GCP Data Fusion pipelines, abort a pipeline, and get third-party job logs.

• Manage GCP Data Fusion credentials in a secure connection profile.

• Connect to any GCP Data Fusion endpoint.

• Introduce all Control-M capabilities to Control-M for GCP Data Fusion, including advanced scheduling criteria, complex dependencies, Resource Pools, Lock Resources, and variables.

• Integrate GCP Data Fusion pipelines with other Control-M jobs into a single scheduling environment.

• Monitor the status, results, and output of GCP Data Fusion pipelines.

• Attach an SLA job to the GCP Data Fusion jobs.

• Run 50 GCP Data Fusion jobs simultaneously per Agent.

Setting up Control-M for GCP Data FusionLink copied to clipboard

This procedure describes how to deploy the GCP Data Fusion plug-in, create a connection profile, and define a GCP Data Fusion job in Control-M SaaS and Automation API.

Before You Begin

• Verify that Automation API is installed, as described in Setting Up the API.

• Verify that Agent version 9.0.21.080 or later is installed.

1. On the Agent host, run one of the following commands to set the Java environment variable:

   • Linux:

     • Bourne shell/bash: export BMC_INST_JAVA_HOME=<java_11_directory>

     • csh/tcsh: setenv BMC_INST_JAVA_HOME <java_11_directory>

   • Windows: set BMC_INST_JAVA_HOME="<java_11_directory>"

2. Run one of the following API commands:

   • To install, type one of the following provision image commands:

     • Linux: ctm provision image GCP_Data_Fusion_plugin.Linux

     • Windows: ctm provision image GCP_Data_Fusion_plugin.Windows

   • To upgrade, type the following command:

     ctm provision agent::update

3. Create a GCP Data Fusion connection profile in Control-M SaaS or Automation API, as follows:

   • Control-M SaaS: Create a Centralized Connection Profile with GCP Data Fusion Connection Profile Parameters

   • Automation API: ConnectionProfile:GCPDF (GCP Data Fusion)

4. Define a GCP Data Fusion job in Control-M SaaS or Automation API, as follows:

   • Control-M SaaS: Create a Job with GCP Data Fusion Job parameters

   • Automation API: Job:GCP Data Fusion

Change LogLink copied to clipboard

The following table provides details about changes that were introduced in new versions of this plug-in:

Plug-in Version	Details
1.0.00	Initial version