BigQuery Integration Requirements

The following are the prerequisites necessary for IBM Automatic Data Lineage to connect to this third-party system, which you may choose to do at your sole discretion. Note that while these are usually sufficient to connect to this third-party system, we cannot guarantee that the connection or integration will be successful since we have no control, liability, or responsibility for third-party products or services, including for their performance.

• BigQuery service account (an account for apps and virtual machines) with the role roles/bigquery.metadataViewer (the predefined BigQuery IAM role) for each extracted project

  • bigquery.datasets.get
    bigquery.datasets.getIamPolicy
    bigquery.models.getMetadata
    bigquery.models.list
    bigquery.routines.get
    bigquery.routines.list
    bigquery.tables.get
    bigquery.tables.getIamPolicy
    bigquery.tables.list
    resourcemanager.projects.get
    resourcemanager.projects.list

• Connection parameters:

  • Private key from BigQuery service account credentials

  • Client email from BigQuery service account credentials

Supported syntax version:

• As of April 08, 2020

Supported BigQuery job types:

• query

Known Unsupported Features

Automatic Data Lineage does not support the following BigQuery features. This list includes all of the features that IBM is aware are unsupported, but it might not be comprehensive.

• Lineage through dynamically executed code through EXECUTE IMMEDIATE