Generating jobs from mapping specifications

You can generate jobs as a step towards creating applications that are passed to a developer in IBM® InfoSphere® DataStage®, or as a way to export a specification. You can further modify these generated jobs in the designer client.

Before you begin

You must have the credentials for InfoSphere DataStage and QualityStage® Designer and be authorized to access the Designer client projects that are to contain your generated job.

About this task

Your mapping specifications or mapping compositions are not required to be complete before you generate a job. You might see warning messages in the mapping specification or mapping composition editor because of missing source or target columns, but you can generally proceed to generate a job. In some rare cases, you might receive errors that can block the successful generation of jobs, such as in the case if the same target column is used in more than one mapping at the same time, or if the mapping composition has been retrieved from an InfoSphere DataStage job by using the Add from DataStage job action.

Procedure

  1. Select a mapping specification or mapping composition from the mapping specifications or mapping compositions folder. Click Generate Job to open the Generate Job wizard.
  2. Click Next.
  3. In the Name of New Job field, specify a name for the job.
  4. Indicate the location for generated jobs by selecting a folder in the DataStage and QualityStage Project or Folder section. The list of projects is only for those projects that you have access to. You can overwrite an existing job by selecting the existing job from the list.
  5. The Use Shared Table Definitions check box is selected by default. If you do not want to associate your job with tables that are already defined in the metadata repository, or that you can define here to add to the metadata repository, then clear this check box.

    The data sources that are used by your mapping specification are listed in the table below the Use Shared Table Definitions check box. The status and location of each data source is also listed in the table.

    1. To add a new table definition to the metadata repository, click Select at the Location for new Table Definitions field. If any of the data sources have a status of New, then the Location for new Table Definitions field is required before you can continue.
    2. When the Select Table Definitions Folder opens, select a folder, or subfolder, and click OK. Click Cancel to stop the add process.
  6. Click Next to create or modify connection configurations for the specified data sources. These connection configurations are stored with the generated job. You use a connection configuration to determine which type of connection stage is generated in DataStage and also to specify the job parameters that are used. A reason for selecting the type of connection stage to use is that a data source connector (or native connector stage) such as Teradata or a Sequential File, can give better performance than an ODBC connector when the DataStage job is run. If you want a job that includes a native connector stage, it is easier to complete the connection configuration here than modifying the generated job.
    1. Select the data source for which you want to configure connection information. Click Manage next to the Connection Configuration list. In the confirmation message that opens, click Create Configuration to continue to create connection information. The Manage Connection Configurations window opens with a New Configuration in the Name field. The Name must be unique within the current project. If you have configuration information already saved, and you want to use most of the same information again, click Create Copy. The current configuration settings for the selected data source are copied so that you can change only the information that you need for another instance of the same configuration.
    2. Specify a name for the settings in the Name field.
    3. Describe this connection in the Description field. This information helps identify the set of configuration settings.
    4. Specify the connector type from the list in the Connector field. This is a list of data source types that are valid for InfoSphere DataStage and QualityStage Designer. The type that you select determines the remaining configuration settings that you need to complete.
    5. Optional: Click the User Name field, and then click Manage Parameters. In the Manage Parameters window, create or modify the user name. You add a property variable, and a default value for the property. This parameter is used in the username field of the data source connector stages that are generated to access the data in each data source. Any parameter that is referenced in one of the generated stages is also added to the list of job parameters associated with the job in the InfoSphere DataStage and QualityStage Designer. You can compile the job in InfoSphere DataStage and QualityStage Designer without needing to modify the authentication information directly in your database connection. If you choose to provide no parameters here, you might be required to update or modify the connection information for every data connection that you need to make in InfoSphere DataStage and QualityStage Designer. However, you can create a valid connection configuration with no parameters.
    6. Click the Password field, and then click Manage Parameters. In the Manage Parameters window, create or modify the password for this connection. You add a property variable, and a default value for the property. Any parameter that is referenced in one of the generated stages is also added to the list of job parameters associated with the job in the InfoSphere DataStage and QualityStage Designer.
    7. Continue adding or updating any additional parameters.
    8. Click Save to save the information to the system.
    9. The properties of the configuration are reflected in a view below the list of data sources.
  7. Optional: Click Next to define naming standards for the current job. If you defined naming standards in Project Properties, those names are used unless you want to define names only for the specific job that you are generating.
  8. Click Finish. The wizard closes when the job is generated.
    Note: A validation mechanism will tell you if the job can be generated at all. If the error message appears on top of the generation wizard, the wizard must be closed and the specification or composition corrected before it can be generated.

What to do next

You can now access the Designer client to view and modify the job.