Big Data File stage: Output page

You can use the Output page to specify details about how the Big Data File stage reads data from flat files.

The Output page allows you to specify details about how the Big Data File stage reads data from one or more flat files. The Big Data File stage can have only one output link, but this can read from multiple files.

It can also have a single reject link. This is typically used when you are writing to a file and provides a location where records that have failed to be written to a file for some reason can be sent. When you are reading files, you can use a reject link as a destination for rows that do not match the expected column definitions.

The Output name drop-down list allows you to choose whether you are looking at details of the main output link (the stream link) or the reject link.

The General tab allows you to specify an optional description of the output link. The Properties tab allows you to specify details of exactly what the link does. The Formats tab gives information about the format of the files being read. The Columns tab specifies the column definitions of the data. The Advanced tab allows you to change the default buffering settings for the output link.

Details about stage properties and formatting are given in the following sections. See Stage editors, "Stage Editors," for a general description of the other tabs.