IBM Support

JR62253: GCS CONNECTOR TO SUPPORT LOADING INTO BIGQUERY TABLE.

Subscribe to this APAR

By subscribing, you receive periodic emails alerting you to the status of the APAR, along with a link to the fix after it becomes available. You can track this item individually or track all items by product.

Notify me when this APAR changes.

Notify me when an APAR for this component changes.

 

APAR status

  • Closed as new function.

Error description

  • Support loading BigQuery table from Google Cloud Storage file
    using GCS connector.
    

Local fix

  • N/A
    

Problem summary

  • GCS connector to support loading into BigQuery table
    

Problem conclusion

  • Google Cloud Storage Connector loads data from the GCS file
    written to the specified Big Query table.
    
    The following new properties are added to the connector in
    the target context.
    
     1. Load data to BigQuery table - Default is No, when this is
    selected, then the below additional properties are required.
     2. Table action - Append / Replace.
    
         Append - Creates and loads data into BigQuery table
        if table doesn't exist. If table already exists, it appends
    the data from the GCS file to the table.
    
        Replace - Drops the existing table, creates a new BigQuery
        table and loads the data from file into the table.
    
      3. Schema name - Provide the BigQuery schema/dataset name.
      4. Table name - Provide the table name where the data needs
         to be loaded.
    
    Note: This feature is supported only for CSV, Avro, Parquet and
    ORC file formats.
    

Temporary fix

Comments

APAR Information

  • APAR number

    JR62253

  • Reported component name

    WIS DATASTAGE

  • Reported component ID

    5724Q36DS

  • Reported release

    B71

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2020-04-20

  • Closed date

    2020-10-18

  • Last modified date

    2020-10-18

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    WIS DATASTAGE

  • Fixed component ID

    5724Q36DS

Applicable component levels

[{"Line of Business":{"code":"LOB10","label":"Data and AI"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSVSEF","label":"IBM InfoSphere DataStage"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"11.7"}]

Document Information

Modified date:
19 October 2020