Watson Pipelines on Cloud Pak for Data

Version: 7.3.0    Included   IBM

Description

With the Watson™ Pipelines service, you can create a pipeline to automate the end-to-end flow of various assets, whether it’s training a model or running scripts assets from the time they are created through their deployment. Automating the end-to-end flow of these assets with a pipeline makes it simpler to build, run, and evaluate models, which shortens the time from conception to production.

You use a pipelines editor canvas to assemble and configure a pipeline that creates, trains, deploys, and updates machine learning models and Python scripts. To design a pipeline, you drag nodes onto the canvas, specify objects and parameters, then run and monitor the pipeline.

Your team can collaborate across roles in the pipelines editor. For example, a data scientist can create a flow to train a model in the editor, and then a ModelOps engineer can add the steps to the flow to automate the process of training, deploying, and evaluating the model to a production environment.

After you assemble the pipeline, you can rapidly update and test modifications with the Pipelines editor canvas, which provides tools to visualize the pipeline, customize it at run time with pipeline parameter variables, and then run it as a trial job or on a schedule.

These tools are available with the Watson Pipelines service:

  • Create a flow to collect data, run scripts, train models, store results, and more.
  • Customize a unique pipelines component that can run a user written function.
  • Schedule jobs to run flows and enhance automation by adding node conditions.

Quick links

Integrated services

Table 1. Related services. The following related services are often used with this service and provide complementary features, but they are not required.
Service Capability
Watson Studio Prepare, analyze, and model data in a collaborative environment with tools for data scientists, developers, and domain experts.
DataStage® Use built-in search, automatic metadata propagation, and simultaneous highlighting of compilation errors to create, edit, load, and run jobs that transform and tailor information for your enterprise.
Watson Machine Learning Build, train, and deploy machine learning models with a full range of tools.