Smart Alerts for service level objectives
Create Smart Alerts for Service Level Objectives (SLO) to send an alert when various thesholds are exceeded, including SLO status, percentage of error budget used, or error budget burn rate. You can further configure the alert by specifying one or more alert channels, attaching custom payloads, or configuring time thresholds.
Permissions
You do not need permission to create Smart Alerts for SLOs. However, your ability to create alerts is limited by the permissions for any entity that is associated with your SLO, such as applications or websites. If you have permission to view an application or website, you can create Smart Alerts for it.
Creating Smart Alerts for SLOs
To create a Smart Alert for SLOs, complete the following steps:
-
From the Instana UI navigation menu, select Service Levels. The Service Levels page shows an overview of all SLOs and their status in alphanumeric order.
-
Click + ADD.
-
Click Add Smart Alert.
Alternatively, you can create a Smart Alert from a specific SLOs dashboard by navigating to that dashboard.
-
The Smart Alert configuration modal is displayed.
-
Select the type of SLO for which you want to create a Smart Alert.
-
Select one or multiple SLOs from the list for which you want to create Smart Alerts.
-
Select the type of blueprint to be alerted on:
-
Error budget: An alert is sent when the error budget usage reaches a certain percentage.
-
Status: An alert is sent when the SLO status is less than the configured threshold.
-
Burn rate: An alert is triggered based on the SLO (Service Level Objective) burn rate and the specified threshold. The burn rate is monitored by using two distinct alert windows, each examining data over different time periods.
- Long alert window This window looks back over an extended period to evaluate whether the burn rate exceeded the threshold. It helps identify issues that develop gradually and might pose future problems if not addressed.
- Short alert window This window examines a shorter time frame to detect if the burn rate surpasses the threshold rapidly. It is useful for detecting sudden spikes in errors or downtime that might be due to immediate and critical issues.
Alert window values must be less than or equal to the selected SLO’s time window. Also, the short alert window must always be shorter than the long alert window.
-
-
Select whether to configure the error budget, SLO status, or burn rate. For the burn rate option, set the threshold value and define the long and short alert windows. For error budget and SLO status, only the threshold percentage needs to be set.
-
Set the time threshold condition that is to be met.
-
Click Select Alert Channels.
- The list of available alert channels is displayed.
-
Select one or more Alert Channels. If no channels appear, create one by clicking Create Alert Channel.
-
Click Add.
-
Configure the alert properties:
- Title: Title for the Smart Alert. Title is used to identify the Smart Alert.
- Alert Level: Choose the style of the alert. You can set the alert to Critical or Warning.
- Triggers Incident: Choose whether the Smart Alert triggers an incident or not.
- Description: Give the Smart Alert a description to provide more context.
Incident triggering is only supported for application entities.
- Optional: Add Custom Payload to the Smart Alert by clicking Add Row and specify the key-value pairs for each added row.
- Click Create.