Designing jobs that use the BigQuery connector

You can use BigQuery Connector stage in the DataStage jobs to read data from the tables in the BigQuery data warehouse or write data into the tables in the BigQuery data warehouse in the specific contexts in which the jobs are designed.

Procedure

  1. Importing BigQuery metadata.
  2. Define a job that includes the BigQuery Connector.
  3. Define a connection to BigQuery.
  4. To set up the BigQuery Connector to read data from BigQuery data warehouse, complete the following steps
    1. Configure the BigQuery Connector as a source.
    2. Set up column definitions on output link (Source).
  5. To set up the BigQuery Connector stage to write data to BigQuery data warehouse, complete the following steps
    1. Configure the BigQuery Connector as a target.
    2. Set up column definitions on output link.
  6. Compile and run the job.