Post-processing
After you load converted data to the Control-M environment, you must do the following:
-
Resolve the conversion results issues that were made available to you during the Converting to Control-M procedure. See the following scheduler topics when resolving conversion results issues:
-
Resolve post-conversion issues for specific schedulers, as described in the following topics:
AutoSys Post-processing
The AutoSys conversion results may include the items described in the following topics:
AutoSys Information and Warning Messages
The following table describes some of the AutoSys information and warning messages, along with their corrective action.
Message ID |
Message Description |
Action |
---|---|---|
INF4002 |
Value truncated. Manually correct the Run As User. |
The defined owner in AutoSys usually refers a fully qualified domain hostname, such as [email protected], which is truncated when it exceeds 30 characters. To correct these errors, ensure that the job looks at the correct Agent and correct username, and delete @company.domain.com. |
INF4003 |
Cannot redirect only STDERR |
None required. AutoSys usually sends STDOUT and STDERR to different locations. Control-M Conversion adjusts both to send to the same location. |
INF4004 |
Calendar required. |
Create a calendar. |
INF4007 |
Updated redirection. |
None required. Use AutoSys variables to redirect the output and point it at another location. AutoSys variables are converted to Control-M variables in the job definitions. |
WRN1005 |
The command line exceeds 512 characters. |
Shorten the command line or manually change it to a Control-M embedded script. |
WRN4000 |
AutoSys utility ‘XXX’ used. |
Identify the utility and review possible solutions. |
WRN4002 |
Unconvertible attribute <attribute name>. |
No available attribute with Control-M. Review options. Reports a function in AutoSys that is not available with Control-M. If the attribute is term_run_time, you must update the Control-M job definition with a notification destination that points to a ctmkilljob script (P) based on EXECTIME options. |
WRN4006 |
Cannot convert attribute <attribute name> for group entities. |
Define the job as cyclic. Start times or minutes are usually defined at the box level. |
WRN4007 |
Failed to convert <sub condition>. |
Unable to convert failure status on the job dependency. Review the predecessor to set a condition on failure that matches up with a condition name in the successor job. |
WRN4009 |
Time zone ‘XXX’ could not be converted to a Server time zone. |
Correct this manually If there are only a few. If there are many, correct the source Time Zone file or mass-update the JIL file. |
WRN4012 |
Conditions nesting cannot be converted <formula substring>. |
Review and adjust manually. This is usually a mix of AND/OR statements or variables that are used as dependencies. |
AutoSys Utilities
The following table describes the AutoSys utilities that you may encounter when running a conversion. The most common utility is SENDEVENT, which is used to manipulate the Broadcom-AutoSys definitions and the live schedule.
Utility Name |
Description |
Action |
---|---|---|
archive_events |
Archives data from the AutoSys database. |
Delete the job. |
as_info |
Lists the AutoSys installation information. |
Delete the job. |
as_safetool |
Manages the AutoSys authentication certificates. |
Delete the job. |
as_server |
Runs the AutoSys Application Server. |
Delete the job. |
auto_svcdesk |
Opens the Service Desk HelpDesk tickets. |
Create a script to call the Service Desk HelpDesk to open incidents and replace the CLI. |
auto_timezone |
Maintains the AutoSys time zones table. |
Delete the job. |
autoaggr |
Aggregates the AutoSys data. |
Replace with ctmjsa *. |
autocal_asc |
Defines the AutoSys calendar utility. |
Delete the job. |
autodwp |
Defines the AutoSys workload utility. |
Delete the job. |
autoflags |
Prints the AutoSys system configuration information. |
Delete the job. |
autoping |
Verifies the connectivity of AutoSys server and client machines. |
Replace this with ctmping, or delete job. |
autorep |
Reports information about AutoSys jobs. |
Delete the job. |
autosec_test |
Obtain the access level AutoSys job assets from the security subsystem. |
Delete the job. |
autostatad |
Retrieves the status of Adapter jobs. |
Delete the job. |
autostatus |
Reports the status of AutoSys jobs. |
Delete the job. |
autosys_secure |
Maintains the AutoSys security features. |
Delete the job. |
autosyslog |
Displays the AutoSys log files. |
Delete the job. |
autotrack |
Tracks changes in the AutoSys database. |
Delete the job. |
chase |
Verifies the status of AutoSys environment. |
Delete the job. |
check_auto_up |
Verifies the status of the AutoSys Scheduler and database. |
Delete the job. |
clean_files |
Removes the AutoSys Agent log files. |
Delete the job. |
cron2jil |
Translates the crontab files into JIL format. |
Delete the job. |
eventor |
Starts AutoSys. |
Delete the job. |
jil |
Defines AutoSys jobs and objects. |
Investigate use of job, and replace with Control-M ctmdefine, ctmcreate, or other utility. |
job_delete |
Cleans the AutoSys job_delete database table. |
Delete the job. |
job_depends |
Reports on AutoSys job dependencies and events. |
Delete the job. |
monbro |
Runs an AutoSys monitor or report (Browser). |
Delete the job. |
sendevent |
STARTJOB KILLJOB DELETEJOB FORCE_STARTJOB JOB_ON_ICE JOB_OFF_ICE JOB_ON_HOLD JOB_OFF_HOLD CHANGE_STATUS STOP_DEMON CHANGE_PRIORITY COMMENT ALARM SET_GLOBAL SEND_SIGNAL |
ctmcontb –ADD Execute the ctmkilljob script. Delete the job. ctmcontb –ADD ctmcontb –DELETE Delete the job. Delete the job. Delete the job. ctmvar –ACTION SET Delete the job. |
time 0 |
Calculates the AutoSys time. |
|
xql |
Provides access to the Sybase database. |
Review the use of this command, potentially delete job, or create a Control-M equivalent |
zql |
Provides access to the Oracle database. |
Review the use of this command, potentially delete job, or create a Control-M equivalent |
TWS Post-processing
The conversion results may include the items described in the following topics:
TWS Recovery Options
The Conversion tool automatically adjusts or reports TWS job RECOVERY conditional statements that are found in the jobs.txt file.
The following table lists the possible options for RECOVERY conditional statements.
Recovery Sub-parameter |
Function |
Control-M Equivalent |
---|---|---|
STOP |
Does not continue processing when the job fails. |
Handled by the Conversion tool. |
CONTINUE |
Continues with the next job in the sequence when the job fails. |
Handled by the Conversion tool. |
RERUN |
Reruns the job when it fails. |
Handled by the Conversion tool. |
AFTER [WORKSTATION] jobname |
Submits a recovery job when the job fails. |
ON NOTOK DO FORCEJOB. |
ABENDPROMPT text |
Issues a message to the operator when the job fails. |
ON NOTOK DO SHOUT. |
RECOVERY AFTER statements issue the following conversion message:
WRN0016 - Unable to create an assisting job to enable the RECOVERY AFTER option.
Scan the jobs.txt file for occurrences of RECOVERY AFTER, and apply the required job-name as the DO FORCEJOB parameters for Control-M.
The ABENDPROMPT statement can also issue messages in the following ways:
-
text: 1–64 characters appear when the job fails.
-
:text: A prompt appears, but it requires no intervention.
-
!text: A prompt does not appear, but it requires input to continue the schedule.
In each scenario, it is advised to issue ON NOTOK, DO SHOUT messages that advise the operator of the appropriate course of action.
TWS Warning Messages
The following table lists a few, but not all, of the TWS information, warning, and error messages, along with their corrective actions.
Product |
Product Message ID |
Message Description |
Action |
---|---|---|---|
Generic |
WRN0002 |
<Vendor> <attribute name> is not supported by Control-M. |
Reports a function in TWS that is not available with Control-M. For more information, see Warning WRN002. |
Generic |
WRN0005 |
<Vendor> <attribute name> and <value> cannot be implemented in Control-M. |
Recovery options (AFTER or ABENDPROMPT have been defined within the job definition. These are not supported by Control-M. You must manually update the following statements:
|
Generic |
WRN0016 |
Unable to create an assisting job. |
RECOVERY AFTER: You must manually update the job definition with IF/ACTIONOFORCEJOB. |
TWS |
WRN1005 |
The command line exceeds 512 characters. |
Shorten the command line or manually change it to Control-M embedded script. |
TWS |
WRN4017 |
Reports errors in the TWS data. |
The AT or UNTIL parameter, for example, should be in hhmm format. Sometimes TWS users forget to fully qualify the time. You must identify the correct time, and either fix TWS, or modify the input file to reflect the correct times. |
TWS |
WRN6007 |
Runcycle definition cannot be converted. |
The required dates are usually in the past and this is not an issue. The job is converted with no scheduling criteria, since it is assumed that these are ad hoc jobs. |
TWS |
WRN6013 |
Attribute is partially converted. |
Create or update a calendar to meet the required criteria. These usually relate to scheduling days, dates, or calendars. |
TWS |
WRN6018 |
Unable to retrieve job definitions. |
Verify that this job is no longer required and clean up TWS, remove it from the source data, or ignore the error. |
TWS |
WRN6024 |
The TWS OPENS statement cannot be convert. |
These are equivalent to the CTMFW. These are typically due to variables being included within the OPENS statement, review, and correct. |
Warning WRN002
The WRN0002 warning message reports a function in TWS that is not available in Control-M.
NDA_CNR_VIP#QTAB_NON_DEQ
- AT 0000
- EVERY 0100
- UNTIL 2359
- ONUNTIL SUPPR
-
ONUNTIL SUPPR: The SUPPRess statements set any job(s) with the SUPPR condition to a state of success once the ONUNTIL time is passed, even though they have not yet started. Control-M handles this condition by following the same rules as ONUNTIL CANC.
-
suppr: The final job stream state is HOLD if the job stream contains at least one every job. Otherwise the final state is calculated using the normal rules and the jobs with the optiononuntil suppr are considered in SUCC state when the until time occurs, even if their dependencies have actually not been released.
-
ONUNTIL CANC: The CANCEL command is effective for a job or job stream and is related to jobs that have not yet dispatched. The job or job stream is canceled when the until time specified expires. Any job or job stream that was dependent on the completion of a job or job stream that was canceled runs because the dependency no longer exists in TWS. To handle this with Control-M, it requires a combination to use CTMPSM parameters.
With a script on the Server or Agent machine with a content of:
- Windows: ctmpsm_script_location”\ctmpsm -UPDATEAJF %2 SETTOOK
- UNIX: ctmpsm_script_location”\ctmpsm -UPDATEAJF $2 SETTOOK
This is an alert mechanism that allows the job to continue. The job or job stream runs when all necessary conditions are met and a notification message is written to the log when the until time elapses. This can be simply addressed using the Control-M Shout options.
TWS Utilities
The following table describes the most common TWS utilities that you might encounter when running a conversion.
Utility Name |
Description |
Action |
---|---|---|
conman |
Issues commands directly to TWS. For more information on common Conman options, see Common Conman Options. |
Replace with Control-M commands. |
datecalc |
Converts date and time information into the required format. |
Replace with ctmcaldate. |
delete |
Removes scripts and output by name. |
None required. |
jobinfo |
Reports job information . |
None required. |
makecal |
Creates calendars. |
None required. |
parms |
Displays, adds and updates parameters. |
Replace with ctmsetvar. |
release |
Frees up resources. |
Replace with ecaqrtab update statements. |
sendevent |
Issues events to the TWS environment. |
Possible Global Conditions. |
Common Conman Options
The following table describes the common conman options in a TWS environment.
Command Name |
Description |
Control-M Action |
---|---|---|
adddep |
Adds a dependency to jobs or schedules. |
ctmcontb -add |
cancel |
Cancels the required job or schedule. |
Options could be ctmkilljob or ctmpsm ‘hold & delete’. |
confirm |
Confirms a job start. |
None required. |
delpred |
Deletes a job or schedule predecessor. |
ctmcontb -delete |
kill |
Kills a job. |
ctmkilljob |
release |
Releases a job or schedule to run. |
Options could be to do nothing and let the operator make the decision or use ctmcontb to dynamically add a condition. |
reply |
Reply to a message prompt. |
No Control-M equivalent. May need to consider CONFIRM. |
submit |
Submits jobs, schedules or DOCOMMAND statements. |
ctmorder/force If Submit DOCOMMAND, there is no equivalent in Control-M. |
Dollar Universe Post-processing
Before you run Dollar Universe HDP jobs, you must configure Control-M otherwise these jobs cannot run correctly.
After you have converted your HDP jobs, the jobs are loaded into Control-M. When you open Control-M client, you see all the converted jobs in a Workspace in the Planning domain. If you have selected Append events for viewing links between jobs in Control-M in the Conversion Tool HDP options, you see how the jobs are linked together in the Planning and Monitoring domains in Control-M. For more information about the Conversion Tool HDP options, see HDP Option Parameters.
Control-M links HDP jobs through the following job prerequisites and job actions in Control-M:
-
Events: Specifies one or more events which correspond to the successful completion of another job. An Event is usually associated with an Event of a successful completion of a predecessor job. Also defines events which are added or deleted to the Events table when the job ends for a predecessor job. For more information, see Events.
-
If-Action: Defines automatic interventions such as rerunning a job or running a remedial job. For more information, see Actions.
If you want to add or delete an HDP job, see HDP Job Management.
When a job runs on several hosts, a message is sent to Control-M script, using the Notify to Program functionality.
-host_group T_1 -job_to_order HDP_TEST_02#0002 -folder EXP_HDP_SES_01_T_1 -MU_type T -relationship CHILDREN -event_variable %%ORDERID
All parameters are mandatory. –event_variable must be defined as %%ORDERID. For further information about the parameters, see Message Parameters.
When the script receives the message, it finds host groups that match the criteria by scanning the MUdependencies.txt file (which contains relations between hosts). The script then performs CTM order on every host group that matches the criteria. The MUdependencies are performed according to the following parameters:
-
-host_group
-
-MU_type
-
-Relationship
MUdependencies.txt contains the following values:
-
HOSTGRP CHILD
-
----------------------------------------------------------------
-
T_1 T_2
-
T_1 T_3
-
T_1 T_1
-
T_1 T_4
-
T_1 T_5
-
T_1 T_6
-
T_1 T_7
-
T_1 T_3
-
T_1 T_1
The script contains the following message:
-host_group T_1 -job_to_order HDP_TEST_02#0002 -folder EXP_HDP_SES_01_T_1 -MU_type T -relationship CHILDREN -event_variable %%ORDERID
The script performs ctmorder on the Child relationship with Type T, related to Host T_1. The script starts scanning the MUdependcies.txt and then performs ctmorder for Job HDP_TEST_02#0002 from Folder EXP_HDP_SES_01_T_1 on 3 host groups:
T_2 , T_3 , T_4 but not on K_1 that has a different type.
HDP Option Parameters
The following table describes the HDP options parameters.
HDP Options |
Description |
---|---|
Append Events for Viewing Links between Jobs in Control-M |
Enables you to view the flow between jobs in the Planning and Monitoring domains in Control-M client. |
Shout Destination Name for ctmorder Script |
Defines the name of the destination file in your environment which is necessary for adding a Shout destination in Control-M client. |
Configuring a Control-M HDP Job
This procedure describes how to configure HDP jobs on Control-M.
Begin
-
Run the Host Group script that was generated in the Conversion. The Host Group script defines where the converted jobs are run on specific host groups. For more information about generating the Host Group script, see Generating Scripts for Control-M/Server .
-
Configure the Control-M environment, as described in Configuring the Control-M Environment. After you have converted HDP jobs, you must add the notification destination otherwise after the first job is run, the next job may not run as the destination has not been defined.
Configuring the Control-M Environment
This procedure describes how to prepare the Control-M environment before you can start running converted HDP jobs in Control-M client.
Before You Begin
-
Ensure that you have generated the Host Group script and you have move it to your Control-M/Server location.
Begin
-
Run the generated Host Group script in the Control-M/Server.
-
In the <conversion home>/workarea/datasources/<project name>/CONVERSIONS/<conversion result name>/HDP folder, copy the following files to your Control-M/Server host:
- orderJob.pl
-
MuDependencies.txt
-
(Windows) orderscript.bat
-
(UNIX) orderJob.sh
-
Start Control-M Configuration Manager.
-
Create a new notification destination, as described in Creating a Notification Destination.
Creating a Notification Destination
This procedure describes how to create a notification destination.
Begin
-
From the icon, select Configuration.
The Configuration domain opens.
-
From the drop-down list, select Control-M/Servers.
The Control-M/Servers pane appears.
-
Click Notification Destinations.
The Notification Destinations dialog box appears.
-
From the Server drop-down list, select a Server.
-
From the notification destination lists that appear, click on the notification destination list that you want to edit.
-
From the Notification Destinations List menu, click .
The Add Destination dialog box appears.
-
Do the following:
-
In the Destination Name, define a logical name for your destination.
The notification destination name must match the Shout Destination Name for 'ctmorder Script' in the HDP Options area in the Conversion Tool, as described in HDP Option Parameters.
-
From the Address drop-down list, select one of the following options:
-
Agent: Sends a notification to a destination on the Agent.
-
Server: Sends a notification to a destination on the Server.
-
-
From the Destination drop-down list, select Program.
-
In the Value field, type the pathname where you placed the orderjobs.bat file, as described in Configuring the Control-M Environment.
-
-
Click Save.
The new destination appears in the Notification Destinations List dialog box. -
Click Done, and repeat this procedure for each notification destination list.
HDP Job Management
After you have imported the HDP jobs into Control-M and configured the Control-M environment, you may want to add or delete an HDP job. If so you need to change the Job Prerequisites and job actions in Control-M to include a new job in the current workflow, otherwise the new job is not run. For more information about adding an HDP job, see: Adding an HDP Job in Control-M.
The Conversion Tool uses the ctmorder utility when you convert HDP jobs to Control-M, which runs or forces one or more jobs from a folder into Server. The parameters for the ctmorder utility appear in the Message field in the If-Action. If you add or delete an HDP job, you need to change the Message parameters, as described in Message Parameters. For more information, see ctmorder.
In the General tab of the Job Properties pane, in the Host/Host Group field, a Hostgroupplaceholder appears. This field is overridden according to the Host group used in the If-Action of the ordered job.
Adding an HDP Job in Control-M
This procedure describes how to add an HDP job in Control-M, that was not converted to Control-M.
If the HDP job is the first job in your Workflow you do not need to create an Event.
Begin
-
From the New area in the Workspace tab, drag and drop one of the job templates from the Job Palette into an existing folder.
A job is created in the existing folder.
-
Link the preceding job to the current Workflow, as described in Linking a Preceding Job to the New Job.
-
Create Events, as described in Creating Events.
-
Create an If-Action, as described in Creating an If-Action.
-
Create an Event, as described in Creating an Event.
Linking a Preceding Job to the New Job
This procedure describes how to link a preceding job to the new job you created in the Workflow in the Planning domain in Control-M client.
In a Workflow you have 2 jobs: Job A and Job B. If you want to add Job A1, the new job flow is JOB A, JOBA1 and JOBB. Click Job A to link JOBA to JOBA1.
Begin
-
Click the preceding job in the workflow that you want the new job to link to.
The Job Properties pane appears.
-
Click Actions.
-
In the If-Actions field, click the If-Action.
The If-Actions window appears.
If there is more than one If-Action, select the If-Action which contains the run job command.
-
In the Message field, change the jobName parameter to the new job name that you have created.
If you want to change the host or host group where you want to run the job, edit the HOST ID/HOST GROUP variables.
Click OK.
-
In the Events field, click .
The Event Details window appears.
-
In the Name field, type the name of the event in the following format:
<event name>%%ORDERID.
The Name must be identical to the Event name that you want the job to link to.
Control-M searches for the job name to link the event.
-
If needed, change the Run Date and Add/Delete The Event fields.
Message Parameters
After conversion, if you want to add or delete an HDP job you need to change the Message field in the If-Action. The Message field contains the ctmorder utility parameters which enables you to order or force jobs in Control-M.
The following table describes the Message parameters:
Parameter |
Description |
---|---|
-folder |
Defines the folder name. For the current folder use %%SCHEDTAB. |
-job_to_order |
Defines the name of job that the current job connects. |
-host_group |
Defines the name of the host group where you want to run the job. This variable is overridden for the specified job when it is run. |
-relationship |
Defines the relationship between the value specified in the -host_group parameter and the host groups that the job specified in the -job_to_order will run on. One of five possible values:
|
-MU_type |
Defines the type of host groups that the specified job will run on. |
-event_variable |
Includes the %%Monitoring_view_variable, which enables you to link jobs in the Monitoring domain. |
Creating Events
This procedure describes how to create Events, which links the events between the predecessor job and the new job you want to add.
Begin
-
In the Events area, click +.
-
From the Events Details window, in the Name field, type the name in the following format:
<event name>%%ORDERID
The Name must be identical to the Event name in the predecessor job that you want the job to link to.
Control-M searches for the job name to link the event.
-
Complete the remaining parameters.
-
Click OK.
-
Add another Event by repeating step 1.
-
From the Events Details window, in the Name field, type the name in the following format:
<job_name> %% <Monitoring_view_variable>
The Monitoring_view_variable enables you to link jobs in the Monitoring domain in Control-M client.
To locate the Monitoring_view_variable, from the predecessor job, click the If-Action and copy the variable from the Message field. If there is more than one If-Action, select the If-Action, which contains the order job command.
-
Repeat Step 3 and 4.
-
Continue with Linking Events.
Linking Events
This procedure describes how to link events, which links the events between the predecessor job and the new job you want to add.
Begin
-
In the Events area, in the Events Relationship field, select Set Manually.
-
Double click the first event.
Events Details window appears.
-
In the Opening Bracket field and select (.
-
In the Relationship field select OR.
-
Click OK
-
Double click the last event.
Events Details window appears.
-
In Relationship select AND.
-
Closing bracket select ).
-
Click OK.
Creating an If-Action
This procedure describes how to create an If-Action for a new HDP job.
You need to copy the destination and message parameters from the predecessor job by clicking the If-Action which contains NOTIFY in the Action field and Destination as the destination that has been defined in the CCM in the Shout Destination.
Begin
-
In the Actions area, from the If-Actions field, click +.
-
In the On field select one of the following:
-
Job Ended OK
-
Job Ended Not OK
-
-
In the Action field, select Notify.
-
In the Destination field, copy the destination from the predecessor job.
-
In the Message field, copy the message from the predecessor job and change the -job_to_order parameter to the new job name that you have created, as described in Message Parameters.
-
In the Urgency field select the Urgency you require.
-
Click OK.
For more information about the If-Action fields, see Actions.
Creating an Event
This procedure describes how to create an Event link the new job to the successor job.
Begin
-
From Action, in the Events area, click +.
-
From the Events Details window, in the Name field, type the name in the following format:
<job_name>%%ORDERID
The Name must be identical to the Event name in the successor job that you want the job you want to link to.
Control-M searches for the name job to link the event.
-
Complete the remaining parameters, as described in Events.
-
Click OK.
Deleting an HDP Job
This procedure describes how to delete an HDP job from Control-M.
Begin
-
Right-click the job and click Delete.
If the deleted job is linked to a predecessor or successor job, see Adding an HDP Job in Control-M.
Cron Post-processing
After you complete the conversion process, both the Conversion_discovery_Cron jobs folder and the new Control-M converted jobs folder appear in the Planning domain.
To disable the original jobs that run on Cron Scheduler that are now running in Control-M, run the disabled jobs that you defined during conversion. This deactivates the original jobs and stops them from running on Cron Scheduler.
Task Scheduler Post-processing
After you complete the conversion process, both the Conversion_discovery_MS jobs folder and the new Control-M converted jobs folder appear in the Planning domain.
To disable the original jobs that run on MS Task Scheduler that are now running in Control-M, run the disabled jobs that you defined during conversion. This deactivates the original jobs and stops them from running on MS Task Scheduler.