Configuring the Cloud Object Storage connector as a source

To configure the Cloud Object Storage connector to read IBM Cloud Object Storage data, you must specify a read mode and configure properties for the read mode that you specified.

Procedure

  1. From the job design canvas, double-click the Cloud Object Storage connector stage.
  2. Set the Read mode property to Read A Single file, Read Multiple Files Using Wildcards or Read Multiple Files Using Regex Expression
  3. Configure the read process for the read mode that you specified.
    Table 1. Reading data from IBM Cloud Storage
    Read mode Procedure
    Read A Single File
    1. Specify the name of the Bucket that contains the file.
    2. Specify the name of the file to read.
    Read Multiple Files Using Wildcards
    1. Specify the name of the Bucket that contains the file.
    2. You can use wildcard characters in the File Name property. You can use any of the following wildcard characters:

    Specify asterisk (*) to match zero or more characters. For example, specify *.txt to match all files with the .txt extension.

    ? Specify a question mark (?) to match one character.

    Examples:
    • csv_write_datatypes.*
    • ?_abc_test*
    Read Multiple Files Using Regex Expression
    1. Specify the name of the Bucket that contains the file.
    2. You can use any JAVA regex expression in the File Name property
    Examples:
    • ^csv_write_datatypes_h.[0-9]$
    • csv_write_datatypes_h.[^12]