Remove Duplicates stage: fast path
This section specifies the minimum steps to take to get a Remove Duplicates stage functioning.
About this task
To use a Remove Duplicates stage:
- Double-click the stage to open the stage editor. On the Stage tab, go to the Properties section. Select the key column. Identical values in this column will be taken to denote duplicate rows, which the stage will remove. Repeat the property to specify a composite key.
- On the Output tab, click Edit in the columns section and in the Maps from column input column, specify how output columns are derived.