IT42215: /DATA DIRECTORY FILLS UP RAPIDLY OVER TIME

APAR status

• Closed as program error.

Error description

• IBM Spectrum Protect Plus uses MongoDB as an internal database.
  This database stores its persistent data in /data/mongo/.
  In IBM Spectrum Protect Plus 10.1.12 and earlier, the /data
  directory continues to fill up over time, causing disk space on
  the /data mount point to be exhausted. This disk space increase
  is caused by the job log collection in MongoDB filling up, which
  causes the WiredTiger (.wt) file stored in /data/mongo/
  corresponding to the job log collection to grow and consume all
  of the space in the /data directory.
  
  This issue can also cause the following:
  
  - Slow loading of job logs in the user interface
  - Slow downloads of job logs for a completed job
  - High memory usage for the mongod service
  - High CPU uage for the mongod service
  - virgo service not starting due to mongod building indices
  - beam.smp process consuming 100% of CPU
  - Abnormally long catalog backup jobs (in terms of job run time)
  - Abnormally large catalog backups (in terms of disk space
  consumed)
  
  Affected Versions: IBM Spectrum Protect Plus 10.1.1 to 10.1.12,
  inclusive.
  

Local fix

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * IBM Spectrum Protect Plus level 10.1.1, 10.1.12, 10.1.3,     *
  * 10.1.4, 10.1.5, 10.1.6, 10.1.7, 10.1.8, 10.1.9, 10.1.10,     *
  * 10.1.11, and 10.1.12                                         *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * See Error Description.                                       *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * Apply the fixing level when available. This problem is       *
  * currently projected to be fixed in IBM Spectrum Protect Plus *
  * level 10.1.12.2 and 10.1.13. Note that this is subject to    *
  * change at the discretion of IBM.                             *
  ****************************************************************
  

Problem conclusion

• IBM Spectrum Protect Plus 10.1.12.2 and 10.1.13 includes a fix
  that ensures that non-viewable entries are no longer added to
  the JOBLOG collection in MongoDB. These fixes also include a
  global preference ("Compact job logs") that can be enabled that
  will instruct the maintenance job to remove existing
  non-viewable JOBLOG entries and compact the JOBLOG collection
  the next time the maintenance job is run.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  SP PLUS

• Fixed component ID

  5737SPLUS

Applicable component levels