Data retention

IBM Cloud Pak for Watson AIOps does retain data for processing, analysis, and historical purposes. Review the following default retention periods to learn the duration that data is retained.

Default data retention periods

Default retention periods for data
Data type Default retention period
Logs - Retention period: 14 days
- Normalized logs are retained for 14 days.
Metrics - Retention period: 15 days
- Metric time series data is retained for 15 days.
Events - Retention period: N/A
- Events are not retained after processing.
Alerts - Retention period: 90 days
- Open alerts are kept indefinitely.
- Closed alerts are archived and retained for 90 days.
Stories - Retention period: N/A
- Open stories are kept indefinitely.
- Closed stories are purged when closed.
Tickets - Retention period: Indefinite
- Closed tickets from a historical time frame are retrieved from the ticketing system based on a user defined date range. Each subsequent retrieval adds to the total data set. Retention controls are not provided.
Topology - Retention period: 30 days
- Valid resources are kept indefinitely.
- Deleted or changed resources are deleted after 30 days.
- Event correlation and associated analytics use the current topology.

Configuring the retention period for topology resources

You can configure the retention period for topology resources if required. For instance, you can increase the retention period to a maximum of 90 days.

The retention period for historical resource data is configured through the HISTORY_TTL time to live (TTL) configuration property. You can increase the retention period by increasing this property value. When a resource is deleted, the resource no longer appears in the UI. Historic representations of the resource, however, are retained and can be accessed in the UI history timeline until the history TTL limit is reached, after which the data is deleted.

Caution: Performance and scalability are affected by the number of resources that are managed, the amount of history present for each resource, and the ingestion rate. If you increase the retention period for historical resource data from the default of 30 days (up to a maximum of 90 days), your system performance (when rendering views) might deteriorate, if as a result of this increase resources have in excess of 25,000 historical entries.

To configure the HISTORY_TTL time to live (TTL) property, complete the following steps on your cluster:

  1. Log in to your cluster.

  2. Open the $ASM_HOME/.env file for editing in your preferred editor.

  3. Edit the HISTORY_TTL setting to set your preferred retention period (in hours). You can change the default setting of 720 hours (30 days) to a maximum of 2160 hours (90 days).

  4. Restart the topology service: