Collecting telemetry data using Prometheus - Grafana

Prometheus and Grafana are powerful open-source tools that work together to provide comprehensive monitoring and alerting solutions for cloud-native environments. Prometheus excels at collecting and storing time-series metrics, including timestamps and optional labels, while Grafana provides a user-friendly interface for visualizing and analyzing this data through customizable dashboards.

Before you begin

  1. A Prometheus and Grafana data source must be available.
  2. The Prometheus Remote Write receiver must be enabled using the flag --web.enable-remote-write-receiver.
  3. Enable Opentelemetry for the required service in IBM® watsonx.data. See Enabling OpenTelemetry for services in watsonx.data.

Procedure

To see the metrics generated for a query:

  1. Select dashboards from Grafana UI navigation menu and click Add visualization.
  2. Choose Prometheus data source.
  3. Select the Prometheus metrics you want to visualize from the query metric drop down list.
  4. Adjust the retention period to specify the time range for the metrics you want to view.