Creating jobs in Data Refinery
You can create a job to run a Data Refinery flow directly in Data Refinery.
To create a Data Refinery flow job:
-
In Data Refinery, click the Jobs icon
from the Data Refinery toolbar and select Save and create a job. -
Define the job details by entering a name and a description (optional). If folders are enabled in your project, you can select the folder where the job is to be saved.
-
On the Configure page, select an environment runtime for the job, and optionally modify the job retention settings.
-
On the Parameters page, view, edit or remove the displayed default parameters for the source and target assets in the data flow. By specifying the source and target assets as parameters in the job, you can create generic data flows and test different scenarios with with different data sources. You can also remove these parameters or define additional parameters.
-
Optional. On the Schedule page, you can add a one-time or repeating schedule. See Job scheduling options.
-
Optional. Set up notifications for the job. You can select the type of alerts to receive.
-
Review the job settings. Then, create the job and run it immediately, or create the job and run it later.
To run jobs, you need a User API key. It is usually created automatically when you create your first job. You can also manually create an API key from your Profile and settings.
To run a job, any source file that you specified as a parameter must exist as an asset in the project and be of the same asset type or connection type as the original source data.
Once the Data Refinery flow job run has been created, it is listed in the Job runs tab. To see job details, click on the job run. For a complete list of jobs in your project, go to the Assets tab.