Building InfoSphere DataStage and InfoSphere QualityStage jobs

You can use the IBM® InfoSphere® DataStage® and IBM InfoSphere QualityStage® Designer to build jobs that cleanse, transform, and write data to a database table or a comma-separated value (CSV) file. After the data is written, you can import the data into IBM Product Master.

Before you begin

Before you can build IBM InfoSphere DataStage and IBM InfoSphere QualityStage jobs, you must:
  • Identify the product data sources and ensure that you have access to the sources.
  • Ensure that you understand the content, structure, and initial quality of the product data sources. You can use the Information Analyzer component of the IBM InfoSphere Information Server product to analyze the data sources.

About this task

You need to use the IBM InfoSphere DataStage Designer to create InfoSphere DataStage or InfoSphere QualityStage jobs.
Important: Ensure that output file produces data in the correct pair format (column, column-value).

Procedure

Open the InfoSphere DataStage Designer and create a job that runs one or more of the following tasks:
  1. Compute a frequency distribution for:
    • Eliminating duplicate records.
    • Matching input records.
    • Determining the clerical pairs.
  2. Validate field values.
  3. Validate that a manufacturer in the source data is recognized by the product.
  4. Correct misspellings.
  5. Specify which part of the hierarchy an item should be placed into based on business rules.
  6. Create the input file of cleansed master product data to load into the product.