BigQuery Manual Inputs

This page explains the specific structure and files accepted by this scanner. See Manta Flow Usage: Preparing Scanner Inputs for additional methods how to provide these inputs via Process Manager or Orchestration API. Check Ingest Source Support how to use Manta Agent to obtain input files from a remote machine or Git.

By default, Manta Flow extracts DDL scripts from the configured BigQuery server and then analyzes the data flows in them. It is also possible to analyze the data flows in the BigQuery SQL or job scripts that work with the configured server.

• Copy the BigQuery SQL scripts to the <MANTA_DIR_HOME>/input/bigquery/${bigquery.dictionary.id}/sql[/project_id[/dataset_name]] folder, where bigquery.dictionary.id is the identification of the configured connection (if not changed in the configuration) and project_id and dataset_name are optional directory structures that give IBM Automatic Data Lineage information about the default project and schema for any unqualified references to database objects used in the scripts. Learn more about unqualified object references.

• Copy the BigQuery job scripts to the <MANTA_DIR_HOME>/input/bigquery/${bigquery.dictionary.id}/jobs folder, where bigquery.dictionary.id is the identification of the configured connection (if not changed in the configuration).