Troubleshooting
Problem
The Kafka service of the Cloud Application Performance Management (APM) server is saving a lot of data, which could lead to a file system full condition.
Symptom
The files in the /opt/ibm/kafka/data/kafka-logs/metric.protobuf* directories are responsible for the growth. Each log file in those directories might be up to 500 Mb by default. When the problem occurs, the number of log files in those directories keeps growing until there are 20 or more log files taking up 10 Gb or more of disk space. At the same time, you would also see that the Db2 WAREHOUS database size is growing, as the data in the metric.protobuf Kafka topic is written to the database.
You might also see the "No data available" message in the Cloud APM dashboard widgets that display real-time data but data is displayed in the widgets that show data from the last 4 hours.
The file system size of some Windows agent systems might grow significantly too.
Document Location
Worldwide
[{"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSVJUL","label":"IBM Application Performance Management"},"Component":"kafka","Platform":[{"code":"PF016","label":"Linux"}],"Version":"8.1.4","Edition":"","Line of Business":{"code":"LOB77","label":"Automation Platform"}}]
Log InLog in to view more of this document
This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.
Was this topic helpful?
Document Information
Modified date:
28 August 2020
UID
ibm11074534