Effective July 12, 2019, we are introducing a new feature in Watson Studio called Jobs.
Jobs will change your experience of running and scheduling Notebook and Data Refinery assets. You will run an asset as a job with a new Jobs user interface. From the Project’s new Jobs tab, you can view all the jobs in a project.
What are jobs?
A job is a way of running assets—such as Data Refinery flows or Notebooks—in a project. You can run a job immediately or schedule a job.
Why Jobs?
Jobs provides an efficient way to run, schedule, and monitor jobs in a Watson Studio project. Currently, we support Notebook and Data Refinery assets for this jobs feature.
Benefits of using Jobs for Watson Studio
- Jobs provides a unified user experience to create, run, and schedule jobs for different assets in Watson Studio.
- Jobs provides a configuration layer on top of assets. You can create multiple jobs associated with a single asset with different runtime configurations. No need to change your original assets.
- Jobs provides a single unified interface to track and monitor all jobs in Watson Studio project.
How to create a job
-
Creating jobs from a project
- From your project, click the Jobs tab and then click New job.
- Enter all required details.
- Select the asset you want to run and an environment runtime for your job.
- Optional: Select to schedule the job. Specify the start time, the time zone, and the repeat settings which depend on the frequency you selected.
-
Creating jobs in Data Refinery
- After you have created a data flow, click the job icon from the Data Refinery toolbar and select Save and create a job.
- Enter all details and create job.
-
Creating jobs for Notebooks
- Click the job icon from the notebook’s menu bar.
- If you haven’t saved a version of the notebook, you will be asked to save one.
- The most recently saved version of the notebook is selected by default.
- The job uses the same environment definition that was selected for the notebook, although you can pick another environment definition.
Migrate existing schedules to the new Jobs UI
Effective July 12, 2019, you can start migrating your existing schedules to the new Jobs UI.
We provide a 30-day migration period (July 12, 2019- August 11, 2019) to migrate from old schedules to the new Jobs UI. During this migration phase, you can access the old schedule UI to view and delete existing scheduled Data Refinery and Notebook assets.
You must manually move your current Data Refinery and Notebook schedules to the new Jobs interface before August 12, 2019.
We will discontinue the old schedule UI on August 12, 2019, after which you will not have access to your old schedules.
Migration steps
Data Refinery
- View the details of your currently scheduled Data Refinery flow. On the Project Assets page, select a Data Refinery flow and then click View schedule (deprecated) from the ACTIONS menu.
- Under the Runs section, go to the Schedule tab. Make note of the schedule details. You can delete this schedule here or come back after you create a new schedule with Jobs UI.
- Go back to the Project Assets page, select a Data Refinery flow, and click Create Job from the ACTIONS menu.
- Select the environment runtime for your job. Create a job. You can run the job immediately or you can create the job and run it later.
- If you didn’t delete the old schedule, follow Steps 1 and 2 above and click the delete icon.
Notebook
- Open the notebook and click the job icon from the notebook’s menu bar. Click on the View job details (deprecated) option. Make note of the schedule details.
- Again, click the job icon from the notebook’s menu bar and click on Create Job. If you haven’t saved a version of the notebook, you are asked to save one. The most recently saved version of the notebook is selected by default.
- Delete the old schedule by using the Delete job (deprecated) option.