Programming IBM Orchestration Pipelines

You can program in a pipeline by using a notebook, or running Bash scripts in a pipeline.

Programming with Bash scripts

Run Bash scripts in a pipeline to compute or process data as part of the flow.

Programming with notebooks

You can use a notebook to run an end-to-end pipeline or to run parts of a pipeline, such as model training.

  • For details on creating notebooks and for links to sample notebooks, see Notebooks.
  • For details on running a notebook as a pipeline job, see Run notebook job.

Using the Python client

To install the library, use pip to install the latest package of ibm-orchestration-pipelines in your coding environment. For example, run the following code in your notebook environment or console.

! pip install ibm-orchestration-pipelines

Use the client documentation for syntax and descriptions for commands that access pipeline components. Currently, the old library is still in use. See Orchestration Pipelines Python client for more details.

Using the IBM Orchestration Pipelines APIs

Use the Orchestration Platform API for working with Orchestration Pipelines in a developer setting.

Configuring CPDCTL with Cloud Pak for Data as a Service

Learn how to configure the CPDCTL tool to work with the command line and IBM Cloud.

Setting up a connection with Cloud Pak for Data as a Service

  1. Set the environment variable ibmcloud_apikey to your IBM Cloud API key.
  2. Run the following script:
    ./cpdctl config profile set cpdaas --url https://cloud.ibm.com --apikey $ibmcloud_apikey
./cpdctl config profile use cpdaas

Linking your profile with IBM Cloud CLI

Run the following command to create a new profile linked to IBM CLI configuration:

cpdctl config profile set <profile-name> --ibmcloud

Parent topic: Creating a pipeline