Defining a job that includes the BigQuery connector

To read data from or write data to BigQuery tables, you can create a job that includes the BigQuery Connector. Then, you add any additional stages that are required and create the necessary links.

Procedure

  1. In the InfoSphere® DataStage® and QualityStage® Designer client, select File > New from the menu.
  2. In the New window, select the Parallel Job icon, and then click OK.
  3. Add the BigQuery Connector to the job:
    1. In the palette, select the Database category.
    2. Drag the BigQuery Connector stage to the canvas.
    3. Optional: Rename the BigQuery Connector stage.
      Choose a name that indicates the role of the stage in the job.
  4. Create the necessary links and add additional stages for the job:
    • For a job that reads from a BigQuery data, create the next stage in the job, and then create an output link from the BigQuery Connector to the next stage.
    • For a job that writes data to BigQuery table, create an input link from the previous stage in the job to the BigQuery Connector.
  5. Save the job.
    Note: The BigQuery Connector does not support reject link.