Troubleshooting storage of historical poll data

If historical poll data is not being stored or deleted correctly, check the log files and recreate the database.

About this task

Historical poll data is stored in the NCPOLLDATA database, which is part of the NCIM database.

Important: Do not manually delete any rows from database tables that store historical poll data, including the polldata, pdEwmaForDay, pdEwmaForWeek, pdEwmaForMonth, pdEwmaForYear tables. Doing so corrupts the tables and is a root cause of problems with the database retention limit.

To troubleshoot the storage of historical poll data, complete the following steps.

Procedure

  1. Check the logs for the ncp_poller process. Check for errors relating to the database retention limit while inserting or deleting poll data. Such errors can involve any database table where raw or aggregated poll data is stored, and look similar to the following:
    Poll data table pdEwmaForDay has exceeded configured retention limit: 28101534

    Check for insert errors when the ncp_model process tries to write discovered data to the NCIM database, which indicate a corrupted NCIM database.

    Check for out-of-memory errors from the NCIM database.

    Any of these errors indicate that you need to recreate the database.

  2. Stop all Network Manager process in the domain, using the following command:
    itnm_stop -domain DOMAIN
  3. For Db2, run the following commands:
    1. Log in to the database server: su - Db2 username
    2. Drop the Db2 database:
      goto /opt/IBM/tivoli/netcool/precision/scripts/sql/db2/
      ./drop_db2_database.sh NCIM -force
    3. Recreate the database:
      ./create_db2_database.sh NCIM username -force

      Where username is the username configured in the DbLogins.domain.cfg file for that domain.

      For example:
      ./create_db2_database.sh NCIM db2inst1 -force
    4. Populate the database:
      ./populate_db2_database.sh NCIM username password

      Where username and password are the username and password configured in the DbLogins.domain.cfg file.

  4. For a non-pluggable Oracle database, run the following commands:
    1. Drop the database:
      ./drop_oracle_database.sh system password

      Where password is the password of the system user.

    2. Recreate the database:
      ./create_oracle_ncadmin_user.sh sys password -------drop oracle user **
      ./create_oracle_database.sh system password
    3. Populate the database:
      ./populate_oracle_database.sh username password

      Where username and password are the username and password configured in the DbLogins.domain.cfg file.

  5. For a pluggable Oracle database, run the following commands:
    1. Drop the database:
      ./drop_oracle_database.sh system Ibm123 -pdb ORCLPDB1 -port 1520 -server localhost
    2. Recreate the database:
      ./create_oracle_ncadmin_user.sh sys Ibm123 -pdb ORCLPDB1 -port 1520 -server localhost
      ./create_oracle_database.sh system Ibm123 -pdb ORCLPDB1 -port 1520 -server localhost 
    3. Populate the database:
      ./populate_oracle_database.sh ncim ncim -pdb ORCLPDB1 -port 1520 -server localhost
  6. Load the MIB information by running the ncp_mib command.
  7. Delete all the logs in the $NCHOME/log/precision directory.
  8. Restart the domain using the following command: itnm_start -domain domain_name