Using Data Observability

With this guide, you can learn how to get started with Data Observability in watsonx.data integration. It walks you through setting up the service, creating alerts for detected data issues and specific metrics, and analyzing alerts to monitor the health and quality of your data.

Complete the guide to learn how to:

  • Access and configure Data Observability.
  • Create alerts based on automated issue detection.
  • Define alerts for specific data quality and performance metrics.
  • Analyze triggered alerts to identify and address data issues.

Guide structure

The guide is organized into the following steps:

  1. Setting up watsonx.data integration and configuring accounts. This step covers initial setup and configuration tasks and is intended for administrators.
  2. Accessing Data Observability. This step explains how to access Data Observability within watsonx.data integration. This topic, and all subsequent topics, are intended for standard users, such as data engineers and analysts.
  3. Analyzing detected issues, creating alerts, and alert receivers. Discover how AI‑based issue detection and remediation can help you identify data problems early. Learn how to define alerts for AI‑detected issues and configure alert receivers for those alerts to help ensure that the right users are notified.
  4. Creating defined alerts for specific metrics. Learn how to set up alerts that trigger when defined thresholds for selected metrics are met or exceeded.
  5. Analyzing triggered alerts. Learn how to review and analyze triggered alerts to understand their root causes and take corrective action.

If you already have access to watsonx.data integration Data Observability, you can start directly with:

  • Step 3: Analyzing detected issues, creating alerts, and alert receivers.
  • Step 4: Creating defined alerts for specific metrics.

Supported data sources

You can observe jobs originating from:

  • DataStage that is part of watsonx.data integration bundle
  • IBM DataStage as a Service

To observe jobs from an IBM DataStage as a Service instance, both Data Observability and the DataStage instance must be deployed in the same region for the account.

Roles and permissions

To work with alerts in Data Observability, you must have the required roles and permissions that are assigned to your account. Make sure that you have the relevant role to create, view, and manage alerts before proceeding.

Learn more

Next steps