Data warehouse monitoring

With Databand, you can:

  • Monitor the query history of your data
  • Take hourly snapshots of key table characteristics
  • Alert on certain data quality metrics in selected columns

The current list of integrations available for data warehouse monitoring includes:

Table transactions

Databand monitors the query history of your tables and collects metadata about the queries that update your tables (query IDs and record counts). To view the transaction history for all monitored tables in the Databand UI, select the History tab for the selected table on the Datasets page.

Table summaries

In addition to logging your tables transactions, Databand takes hourly snapshots of the following key characteristics of your tables:

  • Physical table sizes
  • Total record counts
  • Schemas
  • Times of creation
  • Times of last update

Table summaries can be viewed in the Databand UI by going to the Datasets page and selecting your table.

Data quality checks

When tables in your data warehouse are monitored, you can alert on certain data quality metrics in selected columns. The data quality alerts that are available for the selected columns in your table include:

  • Null checks
  • Duplicate checks

Alerts for data quality for tables can be set up in the Databand UI in one of the following ways:

  • From the Alerts page:
  1. Go to Alerts > Alerts defined > Add alert > Tables data quality.
  2. Select your table and choose the columns to which you want to apply a data quality check.
  • From the Datasets page:
  1. Select your table.
  2. In the Overview tab, click Add alert next to a column to which you want to apply a quality check.
  3. You are redirected to the alert definition screen where you can add more columns to your alert.

Frequency of monitoring

Databand continuously monitors your tables when an integration is created with your data warehouse. After the integration, Databand will collect metadata from the last 12 hours. After that, continuous monitoring occurs on the following schedule:

  • Table summaries are collected every 1 hour.
  • Table transactions are collected every 10 seconds.
  • Data quality checks are run every 1 hour when alerts are defined.

Custom query monitoring

You can create data quality queries to check your datasets for anomalies, see Custom query monitoring.