Troubleshooting
Problem
The Quick filter search index is not being cleaned up after the payload index retention period has expired.
Symptom
Important: This has an Authorized Problem Analysis Reports (APAR) number assigned, which is IV99204. Please follow the APAR for updates on this issue and was resolved in 7.2.8 Patch 10. This issue does not affect QRadar 7.3.0 installations.
As a result of this issue the /store partition might fill up with data and cause the hostcontext service to shut down.
This will be displayed as a Dashboard message.
Cause
The directories that are associated with the Quick Filter search under /store/ariel/events/records/Y/M/D/HH/ do not get deleted after the time specified by Payload Index Retention in the System Settings page.
Diagnosing The Problem
To diagnose the issue us this command.
- Log in to the QRadar user interface.
- Click Admin tab > System Settings Icon
- From System Settings page, locate Database Settings.
- Check the retention period to verify it is the default.
- Using an SSH session log in to the QRadar.
- Type the command
/opt/qradar/support/deployment_info.sh -OS
This will give you a report of which appliances may be have an issue with disk space filling up in /store. If /store is above 95%, then services will stop. - To confirm if this disk space issue is a result of the quick filter search index, type this command using the value from the Payload Index Retention setting from System Settings.
/opt/qradar/support/all_servers.sh -C 'find /store/ariel -type d -name "lucene" -mtime +<Retention Setting>'
In this example we are using the value of 30 days:
/opt/qradar/support/all_servers.sh -C 'find /store/ariel -type d -name "lucene" -mtime +30'
192.168.0.75 -> Qradar728.ibm.com
Appliance Type: 3100 Product Version: 7.2.8.20170726184122
13:43:16 up 3:15, 1 user, load average: 0.36, 0.29, 0.31
------------------------------------------------------------------------
/store/ariel/events/records/2017/7/24/16/lucene
/store/ariel/events/records/2017/7/24/17/lucene
/store/ariel/events/records/2017/7/24/18/lucene
/store/ariel/events/records/2017/7/24/19/lucene
192.168.0.79 -> QFLow.ibm.com
Appliance Type: 1299 Product Version: 7.2.8.20170726184122
13:43:17 up 3:14, 0 users, load average: 0.08, 0.04, 0.01
------------------------------------------------------------------------
If you return results, you are over the retention period for that appliance.
Resolving The Problem
To resolve this issue, please contact QRadar Support for a solution.
Where do you find more information?
Was this topic helpful?
Document Information
Modified date:
10 May 2019
UID
swg22007467