Specifying the IBM DataStage record format in Management Console

When using the IBM® DataStage® mapping type in Management Console for Flat File, you can select one of the following record formats. The type of format you choose depends on your business requirements.

Note: The IBM DataStage mapping type in Management Console for Cloud Object Storage (parquet delivery format) only supports multiple record format.

For more information, see your Management Console documentation.

Single Record

In this format an update operation is sent as a single row. IBM Data Replication for InfoSphere® DataStage generates a file that contains the following as part of each record:

  • Standard columns containing information about the change:
    • DM_TIMESTAMP contains the value from the &TIMSTAMP journal control field.
    • DM_TXID contains the value from the &CCID journal control field.
    • DM_OPERATION_TYPE contains a single character indicating the type of operation that is sent from the source system:
      • "I" for an insert.
      • "D" for a delete.
      • "U" for an update.

      For more information about the journal codes that IBM Data Replication for InfoSphere DataStage generates, see About journal codes.

    • DM_USER contains the value from the &USER journal control field.
  • Before images for columns in the following format: before_mycolumnname
  • After images for columns in the following format: mycolumnname

Multiple Record Format

In this format an update operation is sent as two rows. The first row is the before image and the second row is the after image. IBM Data Replication for InfoSphere DataStage generates a file with journal control fields, before images for columns, and after images for columns. Separate records are produced for before and after images, and the format of each record is as follows:

  • Standard columns containing information about the change:
    • DM_TIMESTAMP contains the value from the &TIMSTAMP journal control field.
    • DM_TXID contains the value from the &CCID journal control field.
    • DM_OPERATION_TYPE contains a single character indicating the type of operation that is sent from the source system:
      • "I" for an insert.
      • "D" for a delete.
      • "B" for the row containing the before image of an update.
      • "A" for the row containing the after image of an update.
    • DM_USER contains the value from the &USER journal control field.
  • The columns in the table mapping in the following format: mycolumnname