Develop

Develop the jobs that move the data from the source to the target.

You can create and develop jobs by using the Designer client. To develop a job, you define the job flow and configure the job as shown in the following figure. You can then save and compile the job, and review any compile errors.

Figure 1. Developing a job

The figure shows the process of developing a job as it is described in the text.

Define the job flow

You can lay out the data flow for a job by arranging the stages on the Designer canvas and connecting the stages with links. The stages represent the data sources, the transformations, and the targets. The stages contain the processing logic for the job. The links carry metadata about the data that is moving between stages.

Configure the job

You can configure the job by adding table definitions, configuring the stages, and adding job parameters.

You add table definitions to the links. Table definitions contain information about the structure of your data and about the location of the tables or files that contain your data. You can import a table definition from the source or target database, or you can create the table definition by using the Designer client.
You configure the stages by specifying the properties that define how the stage processes the data.
You can use parameters in your jobs to specify values at run time, rather than hardcoding the values.

Review compilation errors

You can review the stages that have errors when you compile a job. If a job has a compilation error, you can select an option to highlight the stage that contains the first error in the design. You can review information about the error, and then edit the stage to change any incorrect settings and recompile the job.

In this sample job, a column in the Transformer stage, Trim_Prep, is missing a required property, so the Transformer stage is highlighted.

Figure 2. Reviewing compile errors

The figure shows a job with the Transformer stage highlighted.