Designing jobs that use the Google Cloud Storage Connector

You can use the Google Cloud Storage Connector to develop jobs that read data from and write data to files stored in Google Cloud Storage.

Before you begin

Procedure

  1. Define a connection to Google Cloud Storage.
  2. Importing Google Cloud Storage metadata.
  3. Define a job that contains the Google Cloud Storage Connector.
  4. To set up the Google Cloud Storage Connector to read data from Google Cloud Storage, complete the following steps
    1. Configure the Google Cloud Storage Connector stage as a source.
    2. Set up column definitions on output link.
  5. To set up the Google Cloud Storage Connector to write data to Google Cloud Storage, complete the following steps
    1. Configure the Google Cloud Storage Connector stage as a target.
    2. Set up column definitions on output link.
    3. Optional: Write partitioned data.
  6. Compile and run the job.