Control-M for Apache Kafka via Confluent

Apache Kafka via Confluent enables you to stream, store, and process real-time data across distributed systems.

Control-M for Apache Kafka via Confluent enables you to do the following:

Produce messages in Kafka topics directly from Control-M.
Manage Apache Kafka via Confluent credentials in a secure connection profile.
Connect to any Apache Kafka via Confluent endpoint.
Introduce all Control-M capabilities to Control-M for Apache Kafka via Confluent, including advanced scheduling criteria, complex dependencies, resource pools, lock resources, and variables.
Integrate Apache Kafka via Confluent jobs with other Control-M jobs into a single scheduling environment.
Monitor the status, results, and output of Apache Kafka via Confluent jobs.
Attach an SLA job to the Apache Kafka via Confluent jobs.

Control-M for Apache Kafka via Confluent Compatibility

The following table lists the prerequisites that are required to use the Apache Kafka via Confluent plug-in, each with its minimum required version.

Component	Version
Control-M/EM	9.0.22.000
Control-M/Agent	9.0.22.000
Control-M Application Integrator	9.0.22.000
Control-M Automation API	9.0.22.000

Control-M for Apache Kafka via Confluent is supported on Control-M Web and Control-M Automation API, but not on the Control-M client. You cannot use Promotion with the plug-in.

To download the installation files for each prerequisite, see Obtaining Control-M Installation Files.

Setting up Control-M for Apache Kafka via Confluent

This procedure describes how to deploy the Apache Kafka via Confluent plug-in, create a connection profile, and define a Apache Kafka via Confluent job in Control-M Web and Automation API.

Integration plug-ins released by BMC require an Application Integrator installation. However, these plug-ins are not editable and you cannot import them into Application Integrator. To deploy these integrations to your Control-M environment, import them directly into Control-M with Control-M Automation API.

Before You Begin

Verify that Java is installed, as described in Control-M External Java Installation.
Verify that Automation API is installed, as described in Automation API Installation.

Begin

Create a temporary directory to save the downloaded files.
Download the Apache Kafka via Confluent plug-in from the Control-M for Apache Kafka via Confluent download page in the EPD site.
Do the following to install the Apache Kafka via Confluent plug-in with the Control-M Automation API provision service:
1. Log in as an administrator to the Control-M/EM server host and save the downloaded ZIP file to the following location:
  - Linux: $HOME/ctm_em/AUTO_DEPLOY
  - Windows: <EM_HOME>\AUTO_DEPLOY
2. Log in to the account where Control-M/Agent is installed and run the following provision image command:
  - Linux: ctm provision image Apache_Kafka_via_Confluent_plugin.Linux
  - Windows: ctm provision image Apache_Kafka_via_Confluent_plugin.Windows
Create a Apache Kafka via Confluent connection profile in Control-M Web or Automation API, as follows:
- Web: Create a Centralized Connection Profile with Apache Kafka via Confluent Connection Profile Parameters
- Automation API: ConnectionProfile:Apache Kafka via Confluent
Define a Apache Kafka via Confluent job in Control-M Web or Automation API, as follows:
- Web: Create a Job with Apache Kafka via Confluent Job parameters
- Automation API: Job:Apache Kafka via Confluent

To remove this plug-in from an Agent, see Removing a Plug-in from the Agent. The plug-in ID is APK032026.

Change Log

The following table describes changes that were introduced in new versions of this plug-in.

Plug-in Version	Details
1.0.00	Initial version