Database Maintenance and Cleanup
Older and unneeded data is normally cleaned (deleted) from the database automatically according to system parameters that determine (for example) how long to retain records, how many records to retain, and how often to perform cleanup.
Manual database housekeeping and cleanup is intended for special situations where you might want to clean out more data than is cleaned out by the automatic clean up. For example, if disk space is low, you might want to remove a larger than normal portion of a particular type of data.
If you find that you are performing manual cleanups frequently, especially the same type of cleanup each time, consider adjusting the system parameters so that automatic cleanup matches the required cleanup pattern.
Control-M/EM Database Maintenance and Cleanup
The database server writes a message to an error log file when the server starts or shuts down, and when a database error occurs. This file is not automatically truncated. If not manually truncated, the file utilizes a large amount of disk space. The file created is called an error log for MSSQL, and an alert log for Oracle. [UNIX only].
Whether responsibility of maintaining the error log file goes to the Control-M administrator or the database administrator depends on whether your site is using the dedicated database server provided with the installation, or an existing database server. If you use an existing database server, it is the responsibility of the database administrator to truncate this file on a regular basis.
Some log files are automatically cleaned (deleted) periodically, depending on system parameter definitions. Other log files have limits so that older log messages are deleted as newer ones are written in. The administrator must check the log files to ensure that they are not filling up or too large. If necessary, the administrator must manually delete them. The MaxOldDays system parameter tells how long to retain the Gateway log files before the gateway deletes them.
If you are using a PosgreSQL, the database process logs are stored in the pgsql/data/pg_log directory. This folder is not automatically managed nor cleaned by the database or by Control-M processes. To avoid consuming disk space, BMC recommends to delete log files older than ten days.
The following procedures describe how to perform periodic Control-M/EM database maintenance and cleanup:
-
Checking the database space using thedb_check_space utility.
-
Extending the Oracle or MSSQL database using the em_database_menu utility
Removing Old Archived Viewpoints
This procedure describes how to remove old archived viewpoints, which are recordings of job changes (data, conditions, and resources) that occur in the Active Jobs file on any given day.
Begin
-
Display the Control-M/EM Root Menu (root_menu).
-
In the Control-M/EM Root Menu, enter the number for the Database Maintenance option.
-
In the Database Maintenance menu, enter the number for the Erase Old Nets option.
-
Enter q to exit the Database Maintenance menu and the Root menu.
(Windows only) Gateway automatically removes old archived networks.
Deleting Audit Records from the root_menu
This procedure describes how to delete audit records of the Audit_activities table in the database from the root_menu.
Begin
-
Display the Control-M/EM Root Menu (root_menu).
-
In the Control-M/EM Root Menu, enter the number for the Database Maintenance option.
-
In the Database Maintenance menu, enter the number for the Erase Audit Data option.
-
Enter q to exit the Database Maintenance menu and the Root menu.
Deleting Audit Records with a Script
This procedure describes how to delete audit records of the Audit_activities table in the database with a script (UNIX or Windows).
Begin
-
Log in to the Control-M/EM host computer as a Control-M/EM administrator.
-
Enter the following command. If you do not specify -U and -P, you will be prompted to enter the DBO user name and password.
erase_audit_data [-date yyyymmdd] [-U EM_DBO_name] [-P EM_DBO_password]
Records written before the specified date are deleted.
Control-M/ServerDatabase Maintenance and Cleanup
The database server writes a message to an error log file when the server is started or shut down, and when a database error occurs. This file is not automatically truncated. If not manually truncated, the file will utilize a large amount of disk space. The file created is called an error log for MSSQL, and an alert log for Oracle. [UNIX only]
The responsibility of maintaining the error log file goes to the Control-M administrator or the database administrator depending on whether your site is using the database server provided with the installation, or a current database server when your site:
-
Uses a BMC-supplied PostgreSQL database server, it is the responsibility of the Control-M administrator to truncate this file on a regular basis
-
Uses a current database server, it is the responsibility of the database administrator to truncate this file on a regular basis
Control‑M/Server writes process log trace files to the proclog directory.
Each time Control-M/Server starts:
-
The new logs are saved to one of the following locations:
-
UNIX: $CONTROLM_SERVER/proclog
-
Windows: <ctm_installation>\proclog
-
-
The proclog file from the previous session is saved to one of the following locations:
-
UNIX: $CONTROLM_SERVER/proclog.sav
-
Windows: <ctm_installation>\proclog.sav
-
The higher the trace level, the larger the log files. If Control-M/Server entities operate for a long time using a trace level greater than zero, these log files utilize a large amount of disk space.
If you are using a PosgreSQL, the database process logs are stored in the pgsql/data/pg_log directory. This folder is not automatically managed nor cleaned by the database or by Control-M processes. To avoid consuming disk space, BMC recommends to delete log files older than ten days.
The following procedures describe how to perform a periodic Control-M/Server database cleanup:
-
Extending an Oracle or MSSQL database using thedbu_menu utility.
Cleaning up the Control-M/Server Proclog Directory
This procedure describes how to clean up the Control-M/Server proclog directory. The Control-M/Server administrator should delete these log files when they are no longer needed.
Begin
-
Display the Control-M Main Menu by typing the ctm_menu command.
-
In the Control-M Main menu, type the number corresponding to the Troubleshooting option.
-
In the Troubleshooting menu, enter the number corresponding to the Erase Proclog Files option.
This option erases the contents of the current process log file either for all active Control‑M/Server processes or for any specific active process.
-
Specify the 2-character code for a specific process, or ALL for all current process log files.
Proclog Utility Parameters
Log retention is determined by the parameters in the following table:
Parameter | Description |
---|---|
OS_DIAG_LIMIT_LOG_VERSIONS |
Number of generations of diagnostic log information to keep for a process or a thread Valid values:
Default: -1 (In the shipped config.dat, the default value is overridden by 10. Refresh Type: Recycle |
OS_DIAG_LIMIT_LOG_FILE_SIZE |
Maximum size (MB) of diagnostic log files for a process or a thread. Valid values:
Default: -1 (In the shipped config.dat, the default value is overridden by 10.) Refresh Type: Recycle |
Database Parameters
Database configuration parameters are specified during installation, before the Control‑M/Server database is created. You can subsequently change these parameters and rebuild the Control‑M/Server database by using the Database Menu menu for PostgreSQL, MSSQL, and Oracle.
UNIX: System paths or raw partitions for the data and log files must be unique (MSSQL and PostgreSQL).
The following lists configuration parameters for the following databases:
Oracle Parameters
The following table lists the Control-M/Server database parameters for the Oracle environment:
Parameter | Description |
---|---|
Control‑M Database Instance Name |
Defines the name of the Oracle SQL server. Valid Values: 1–8 characters, A–Z, a–z, and _ (underscores). Default: ctrlm |
Control-M INDEX Tablespace File Location |
Defines the full path name to the Control-M INDEX tablespace file. Default: /<controlm_home_dir>/oracle/oradata/ctrlm/indx01.dbf |
Control‑M INDEX Tablespace Size |
Defines the size of the Control-M INDEX tablespace file. Default: 50 MB |
Control-M Listener Port Number |
Defines the TCP/IP port for communication between Control‑M and Oracle SQL Server. The port must be dedicated to this purpose. Choose a number in the range 1024 to 65534 inclusive. Default: 1521 Refresh Type: Recycle |
Control-M RBS (Rollback Segment) Tablespace File Location |
Defines the full path name to the Control-M RBS tablespace file. Default: /<controlm_home_dir>/oracle/oradata/ ctrlm/rbs01.dbf |
Control-M RBS Tablespace Size |
Defines the size of the Control-M RBS tablespace file Default: 50 MB |
Control-M SYSTEM Tablespace File Location |
Defines the full path name to the Control-M SYSTEM tablespace file. Default: /<controlm_home_dir>/oracle/oradata/ ctrlm system01.dbf |
Control-M SYSTEM Tablespace Size |
Defines the size of the Control-M SYSTEM tablespace file. Default: 50 MB |
Control-M TEMP Tablespace File Location |
Defines the full path name to the Control-M TEMP tablespace file. Default: /<controlm_home_dir>/oracle/oradata/ctrlm/temp01.dbf |
Control‑M TEMP Tablespace Size |
Defines the size of the Control-M TEMP tablespace file Default: 100 MB |
Name of the First Database Log File |
Defines the full path name of the first database log file. Default: /<controlm_home_dir>/oracle/oradata/ctrlm/log01.dbf |
Name of the Scond Database Log File |
Defines the full path name of the second database log file Default: /<controlm_home_dir>/oracle/oradata/ctrlm/log02.dbf |
Name of the Tablespace Data File |
Defines the full path name of Control-M/Server database data file. Default: /<controlm_home_dir>/oracle/oradata/ctrlmdata.dbf |
Oracle CDROM Name |
Defines the name of CDROM device containing the Oracle installation CDROM. |
Oracle Home Directory |
Defines the directory where Oracle binary files are stored. Default: /<controlm_home_dir>/oracle |
Oracle Server Host Name |
Defines the host computer name of an existing Oracle server. |
Oracle SYSTEM User Password |
Defines the password of the Oracle SYSTEM user. |
Size of Control-M Database Log Files |
Defines the size of each database log file. There are two files of equal size. Default: 20 MB |
Tablespace Size |
Defines the total size of the Control-M/Server database. Default: 250 MB |
Tablespace User |
Defines the name of Control-M/Server database user. Default: controlm |
User Password |
Defines the password for the Control‑M/Server database user (6–30 characters, alphanumeric). The characters you enter do not echo for security reasons. Control‑M processes and utilities uses the password to access the Control‑M/Server database. Default: password |
MSSQL Parameters
The following table lists Control‑M/Server database parameters for the MSSQL environment:
Parameter | Description |
---|---|
Server Host Name |
Defines the host name of the machine where the SQL Server resides. If you install the dedicated SQL Server, the value is the current machine. For a silent installation the value of this parameter is blank, and the installation procedure uses the name of the current machine. |
Query Port Number -and- Backup Port Number |
Defines two TCP/IP ports for communication between Control‑M/Server and the SQL Server. The port numbers must be different from each other. If these port numbers are already used by an existing application, choose other values, each in the range 1024 to 65534 inclusive. Default: 7102 and 7103 Refresh Type: Recycle |
System Administrator (SA) Password |
Defines the password (6 to 30 alphanumeric characters) for the database administrator (user sa). The characters you enter, do not echo for security reasons. Control‑M/Server utilities uses the password to access restricted sections of the Control‑M/Server database. Default: password |
Control‑M/Server Database Name |
Defines the name for the Control‑M/Server database, which must be unique. If you use unique values for owner name, database name, and device assignments, a new database is built on the server. By using an existing owner name, database name, and device assignment, you delete and recreate the database elements. Every computer type uses a different character set for the server. Default: ctrlm |
Control‑M/Server Database Owner |
Defines the database name of the Control‑M/Server database owner. The installation script creates this user in the database. Control‑M/Server uses the name when accessing its database. Default: ctrlm |
Control‑M/Server Database Owner (DBO) Password |
Defines the password of the Control‑M/Server database owner (6 to 30 alphanumeric characters). The characters you enter, do not echo for security reasons. The first character must be a letter (A – Z). Control‑M/Server uses the password for processes and utilities to access the Control‑M/Server database. Default: password |
Data Device Logical Name |
Defines the name of the device where the Control‑M/Server database is located. Default: ctrlm_ux |
Data Device Path |
Defines the full path name of the Control‑M/Server database. Default: c:\<sql_dir>\data\ctrlm_ux |
Data Device Size |
Defines the amount of space (MB) allocated for the data portion of the Control‑M/Server database. Default: 75 (MB) |
Log Device Logical Name |
Defines the name of the device where the Control‑M/Server database is located. Default: ctrlm_log |
Log Device Location |
Defines the full path name where the Control‑M/Server database log is located. Default: c:\<sql_dir>\data\ctrlm_log |
Log Device Size |
Defines the amount of space (MB) to allocate for the Control‑M/Server database log. Default: 25 (MB) |
PostgreSQL Parameters
The following table lists the Control‑M/Server database parameters for the PostgreSQL environment:
Parameter | Description |
---|---|
Host Interface Name |
Defines the host name of the machine where the PostgreSQL Server resides. If you install the dedicated PostgreSQL Server, the value is the current machine. For a silent installation, the value of this parameter is blank, and the installation procedure uses the name of the current machine. |
Port Number |
Defines the TCP/IP port for communication between Control‑M/Server and the PostgreSQL Server. If this port number is already used by an existing application, choose another value, in the range 1024 to 65534 inclusive. Default: 5432 Refresh Type: Recycle |
Database Administrator Name |
Defines the database administrator name.
|
Database Administrator Password |
Defines the password for the database administrator. The characters you enter do not echo for security reasons. Control‑M/Server utilities uses the password to access restricted sections of the Control‑M/Server database. ' (apostrophe) characters are invalid in PostgreSQL. |
Control‑M/Server Database Name |
Defines the name of the Control‑M/Server database. This name must be unique, and contain up to 30 alphanumeric, lowercase characters (including the underscore character). |
Control‑M/Server Database Owner |
Defines the database name for the Control‑M/Server database owner. The installation script creates this user in the database. Control‑M/Server uses this when accessing its database. If you use unique values for owner name, database name, and device assignments, a new database is built on the server. By using an existing owner name, database name, and device assignment, you delete and recreate the database elements. Every computer type uses a different character set for the server. |
Control‑M/Server Database Owner (DBO) Password |
Defines the password for the Control‑M/Server database owner. This name must be unique, and must contain up to 30 alphanumeric lowercase characters (including the underscore character). The characters you enter do not echo for security reasons. Control‑M/Server processes and utilities use the password to access the Control‑M/Server database. The single apostrophe symbol (" ‘ ") is not permitted for PostgreSQL. |
Database Scalability |
Defines the amount of resources in the operating system of the computer on which the PostgreSQL server is employed. Valid Values:
|
(Windows) Database Server Home Directory |
Defines the full path name of the location where the PostgreSQL database server resides: <Control-M/Server path>/pgsql. Only for PostgreSQL database server on Windows. |
(UNIX) Database Location |
Defines the full path name of the location in which the Control-M/Server database should be installed: $PGHOME You must create this location prior to installing the Control-M/Server database. Only for PostgreSQL database server on UNIX. |