Column Import stage: Stage tab (DataStage)

The Column Import Stage tab enables you to control aspects of the Column Import stage.

Double-click the stage to open the stage properties panel.

Properties

You can specify the following properties:
Table 1. Properties
Category/Property Values Default Mandatory? Repeats? Dependent of
Input/Import input column Input Column N/A Y N N/A
Output/Column method Explicit/Schema File Explicit Y N N/A
Output/Column to import Output Column N/A Y (if Column Method = Explicit) Y N/A
Output/Schema file Path name N/A Y (if Column Method = Schema file) N N/A
Options/Keep input column True/False False N N N/A
Options/Reject Mode Continue (warn) /Output/Fail Continue N N N/A

The Column Import stage has the following properties on the Stage tab in the Input section:

Input section on Stage tab

The Column Import stage has the following properties on the Stage tab in the Input section:
Import input column
Specifies the name of the column containing the string or binary data to import.

Output section on Stage tab

The Column Import stage has the following properties on the Stage tab in the Output section:
Column method
Specifies whether the columns to import should be derived from column definitions on the Output tab Columns section (Explicit) or from a schema file (Schema File).
Column to import
Specifies an output column. The metadata for this column determines the type that the import column will be converted to. Repeat the property to specify multiple columns. Click Edit to select or add multiple columns. The order of the Columns to Import that you specify should match the order on the Columns tab.
Schema file
Instead of specifying the source data type details through the output column definitions, you can use a schema file. However, if you have defined columns on the Columns tab, you should ensure these match the schema file. Type in a path name.

Options section on Stage tab

The Column Import stage has the following properties on the Stage tab in the Options section:
Keep input column
Specifies whether the original input column should be transferred to the output data set unchanged in addition to being imported and converted. Defaults to False.
Reject mode
The values of this property specify the following actions:
  • Fail. The stage fails when it encounters a record whose import is rejected.
  • Output. The stage continues when it encounters a reject record and writes the record to the reject link.
  • Continue (warn). The stage is to continue but report failures to the log file.

Advanced

The Advanced section on the Stage tab allows you to specify the following options:
  • Execution Mode. The stage can execute in parallel mode or sequential mode. In parallel mode the input data is processed by the available nodes as specified in the Configuration file, and by any node constraints specified on the Advanced tab. In Sequential mode the entire data set is processed by the conductor node.
  • Combinability mode. This is Auto by default, which allows IBM® DataStage® to combine the operators that underlie parallel stages so that they run in the same process if it is sensible for this type of stage.
  • Preserve partitioning. This is Propagate by default. It adopts Set or Clear from the previous stage. You can explicitly select Set or Clear. Select Set to request that next stage in the job should attempt to maintain the partitioning.