Installing watsonx Orchestrate
An instance administrator can install watsonx Orchestrate on IBM® Software Hub Version 5.2.
- Who needs to complete this task?
-
Instance administrator To install watsonx Orchestrate, you must be an instance administrator. An instance administrator has permission to install software in the following projects:
- The operators project for the instance
-
The operators for this instance of watsonx Orchestrate are installed in the operators project.
In the installation commands, the
${PROJECT_CPD_INST_OPERATORS}environment variable refers to the operators project. - The operands project for the instance
-
The custom resources for the control plane and watsonx Orchestrate are installed in the operands project.
In the installation commands, the
${PROJECT_CPD_INST_OPERANDS}environment variable refers to the operands project.
- When do you need to complete this task?
-
Review the following options to determine whether you need to complete this task:
- If you want to install multiple services at the same time, follow the process in Running a batch installation of solutions and services instead.
- If you didn't install watsonx Orchestrate as part of a batch installation, complete this task
to add watsonx Orchestrate to your environment.
Repeat as needed If you are responsible for multiple instances of IBM Software Hub, you can repeat this task to install more instances of watsonx Orchestrate on the cluster.
Information you need to complete this task
Review the following information before you install watsonx Orchestrate:
- Version requirements
-
All of the components that are associated with an instance of IBM Software Hub must be installed at the same release. For example, if the IBM Software Hub control plane is installed at Version 5.2.2, you must install watsonx Orchestrate at Version 5.2.2.
- Environment variables
-
The commands in this task use environment variables so that you can run the commands exactly as written.
- If you don't have the script that defines the environment variables, see Setting up installation environment variables.
- To use the environment variables from the script, you must source the environment variables
before you run the commands in this task. For example,
run:
source ./cpd_vars.sh
- Security context constraint
-
watsonx Orchestrate works with the default Red Hat OpenShift Container Platform security context constraint,
restricted-v2.
- Storage requirements
- You must specify storage classes when you install watsonx Orchestrate. The following storage classes are recommended. However, if you don't use these storage classes on your cluster, ensure that you specify a storage class with an equivalent definition.
- 5.2.0
5.2.1 By default,
ibm-slate-30m-english-rtrvris enabled during watsonx Orchestrate installation. To avoid installation failures when installing from a private registry, ensure that this specific model is also mirrored during the mirroring process. Use the following values during the mirroring process:Mirror Watsonx AI model : ibm-slate-30m-english-rtrvr
IMAGE_GROUPS: ibmwxSlate30mEnglishRtrvr
- Starting from Version 5.2.2, if you choose to configure external models through AI Gateway, installing watsonx.ai™ and Red Hat OpenShift AI becomes optional.
- Starting from Version 5.2.2, embedding model can be configured using AI Gateway. For more information, see Registering the embedding model through AI Gateway.
Before you begin
This task assumes that the following prerequisites are met:
- System requirements
- This task assumes that the cluster meets the minimum requirements for watsonx Orchestrate.
Where to find more information If this task is not complete, see System requirements. - Workstation
- This task assumes that the workstation from which you will run the installation is set up as a
client workstation and has the following command-line interfaces:
- IBM Software Hub CLI:
cpd-cli - OpenShift CLI:
oc
Where to find more information If this task is not complete, see Setting up a client workstation. - IBM Software Hub CLI:
- Control plane
- This task assumes that the IBM Software Hub
control plane is installed.
Where to find more information If this task is not complete, see Installing an instance of IBM Software Hub. - Private container registry
- If your environment uses a private container registry (for example, your cluster is air-gapped),
this task assumes that the following tasks are complete:
- The watsonx Orchestrate software images are mirrored to the private container
registry.
Where to find more information If this task is not complete, see Mirroring images to a private container registry. - The
cpd-cliis configured to pull theolm-utils-v3image from the private container registry.Where to find more information If this task is not complete, see Pulling the olm-utils-v3 image from the private container registry.
- The watsonx Orchestrate software images are mirrored to the private container
registry.
- GPU operators
- If you plan to use
features that require GPUs, this task assumes that the operators required to use GPUs are
installed.
Where to find more information If this task is not complete, see Installing operators for services that require GPUs. - Red Hat OpenShift AI
- If you plan to use
features that require Red Hat OpenShift AI, this task assumes that
Red Hat OpenShift AI is installed.
Where to find more information If this task is not complete, see Installing Red Hat OpenShift AI. - Multicloud Object Gateway
- This task assumes that the following tasks are complete:
- Multicloud Object Gateway is installed and
configured.
Where to find more information If this task is not complete, see Installing Multicloud Object Gateway. - The secrets that enable watsonx Orchestrate to connect to Multicloud Object Gateway exist.
Where to find more information If this task is not complete, see Creating secrets for services that use Multicloud Object Gateway.
- Multicloud Object Gateway is installed and
configured.
- Red Hat OpenShift Serverless Knative Eventing
- This task assumes that Red Hat OpenShift Serverless Knative Eventing is
installed.
Where to find more information If this task is not complete, see Installing Red Hat OpenShift Serverless Knative Eventing.
Preparing to install
- Verify the Identity and Access Management (IAM)
- Verify that the Identity and Access Management (IAM) Service is enabled. By default, the IAM service is enabled with the IBM Software Hub Version 5.2.0. For more information, see Integrating with the Identity Management Service.
- GPU requirements for the models
- For details on the GPU requirements for the models, see GPU requirements for models.
- Other model requirements
- Starting from Version 5.2.2, you must configure at-least one LLM model and one embedding model in each service-instance of watsonx Orchestrate.
Procedure
Complete the following tasks to install watsonx Orchestrate:
Specifying installation options
If you plan to install watsonx™ Orchestrate
configuration, specify the appropriate installation options in a file named install-options.yml in the cpd-cli
work directory (For example: cpd-cli-workspace/olm-utils-workspace/work).
- The same cluster as watsonx Orchestrate
-
Choosing a model GPU requirements You must use one of the models provided by IBM. The features that you plan to use determine the model or models that you must install.
You must have sufficient GPU on the cluster where you plan to install watsonx Orchestrate. - A remote or external cluster by using AI gateway
-
Choosing a model GPU requirements You can choose whether to use: - One of the models provided by IBM
If you use the models provided by IBM, the features that you plan to use determine the models that you must install.
- A custom model
If you use a custom model, you must register the external model through AI gateway.
Local GPU is not required. Remote GPU might be required:- If you plan to host models on a remote cluster, you must have sufficient GPU on the cluster
where you plan to install the foundation models.
For more information on GPU requirements, consult the documentation from the model provider.
- If you plan to use models hosted by a third-party, you don't need GPU.
- One of the models provided by IBM
- Only the agentic AI features
- The agentic AI features and legacy features, such as conversational search and conversational skills.
- Models provided by IBM
-
Review the following table to determine which model or models provide the features that you need:
Model Agentic AI
Domain agentsAgentic AI
Tool and API orchestrationConversational search
Answer generationConversational search
Query rewriteConversational skills
Custom actions information gatheringgranite-3-8b-instruct No No Yes No No ibm-granite-8b-unified-api-model-v2 No No No Yes Yes llama-3-1-70b-instruct No Yes Yes Yes Yes llama-3-2-90b-vision-instruct Yes Yes Yes Yes Yes Important: The llama-3-2-90b-vision-instruct model is recommended over the llama-3-1-70b-instruct model. The llama-3-2-90b-vision-instruct model offers:- Better performance
- More accurate results
Private container registry users: You must mirror the images for the models that you plan to use to the private container registry. For more information, see Determining which models to mirror to your private container registry.
Choose the appropriate YAML based on where you plan to install the foundation models:
- Install foundation models on the same cluster as watsonx Orchestrate
- Choose the appropriate YAML based on the features that you want to install:
- Agentic features only
- Choose the appropriate YAML based on the model that you want to install.
- To install the llama-3-1-70b-instruct model, choose the appropriate YAML
based on the version of IBM Software Hub you installed:
- Version 5.2.0 or Version 5.2.1
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_install_mode: lite watson_orchestrate_watsonx_ai_type: true watson_orchestrate_ootb_models: - llama-3-1-70b-instruct - ibm-slate-30m-english-rtrvr - Version 5.2.2
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_watsonx_ai_type: true watson_orchestrate_ootb_models: - llama-3-1-70b-instruct - ibm-slate-30m-english-rtrvr
- To install the llama-3-2-90b-vision-instruct model, choose the appropriate
YAML file based on the version of IBM Software Hub
you installed:
- Version 5.2.0 or Version 5.2.1
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_install_mode: lite watson_orchestrate_watsonx_ai_type: true watson_orchestrate_ootb_models: - llama-3-2-90b-vision-instruct - ibm-slate-30m-english-rtrvr - Version 5.2.2
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_watsonx_ai_type: true watson_orchestrate_ootb_models: - llama-3-2-90b-vision-instruct - ibm-slate-30m-english-rtrvr
- To install the llama-3-1-70b-instruct model, choose the appropriate YAML
based on the version of IBM Software Hub you installed:
- Legacy features and agentic AI features
- The parameters that you specify depend on the models that you want to install:
- To install the granite-3-8b-instruct model, choose the appropriate YAML
based on the version of IBM Software Hub you installed:
- Version 5.2.0 or Version 5.2.1
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_watsonx_ai_type: true watson_orchestrate_ootb_models: - granite-3-8b-instruct - ibm-slate-30m-english-rtrvr - Version 5.2.2
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_watsonx_ai_type: true watson_orchestrate_install_mode: agentic_skills_assistant watson_orchestrate_ootb_models: - granite-3-8b-instruct - ibm-slate-30m-english-rtrvr
- To install the ibm-granite-8b-unified-api-model-v2 model, choose the
appropriate YAML based on the version of IBM Software Hub you installed:
- Version 5.2.0 or Version 5.2.1
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_watsonx_ai_type: true watson_orchestrate_syom_models: - ibm-granite-8b-unified-api-model-v2 watson_orchestrate_ootb_models: - ibm-slate-30m-english-rtrvr - Version 5.2.2
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_watsonx_ai_type: true watson_orchestrate_install_mode: agentic_skills_assistant watson_orchestrate_syom_models: - ibm-granite-8b-unified-api-model-v2 watson_orchestrate_ootb_models: - ibm-slate-30m-english-rtrvr
- To install the llama-3-1-70b-instruct model, choose the appropriate YAML
based on the version of IBM Software Hub you installed:
- Version 5.2.0 or Version 5.2.1
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_watsonx_ai_type: true watson_orchestrate_ootb_models: - llama-3-1-70b-instruct - ibm-slate-30m-english-rtrvr - Version 5.2.2
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_watsonx_ai_type: true watson_orchestrate_install_mode: agentic_skills_assistant watson_orchestrate_ootb_models: - llama-3-1-70b-instruct - ibm-slate-30m-english-rtrvr
- To install the llama-3-2-90b-vision-instruct model, choose the appropriate
YAML based on the version of IBM Software Hub you installed:
- Version 5.2.0 or Version 5.2.1
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_watsonx_ai_type: true watson_orchestrate_ootb_models: - llama-3-2-90b-vision-instruct - ibm-slate-30m-english-rtrvr - Version 5.2.2
-
################################################################################ # watsonx Orchestrate parameters ################################################################################ watson_orchestrate_watsonx_ai_type: true watson_orchestrate_install_mode: agentic_skills_assistant watson_orchestrate_ootb_models: - llama-3-2-90b-vision-instruct - ibm-slate-30m-english-rtrvr
- To install the granite-3-8b-instruct model, choose the appropriate YAML
based on the version of IBM Software Hub you installed:
- Using foundation models on a remote or external cluster by using AI gateway
-
Important: If you choose this option, you must register the models through AI gateway after you install watsonx Orchestrate.
Choose the appropriate YAML based on the features that you want to install:
| Property | Description |
|---|---|
watson_orchestrate_watsonx_ai_type |
Specify whether to install Inference foundation models
( You can install the foundation models on:
|
watson_orchestrate_install_mode |
Specify the features that you plan to install. The usage of this option depends on the version of IBM Software Hub you installed:
|
watson_orchestrate_ootb_models |
This option is valid only if you install the foundation models on the same cluster as watsonx Orchestrate
( Specify whether to install one or more general models. Install models based on the features that you want to enable.
|
watson_orchestrate_syom_models |
This option is valid only if:
Specify whether to install a specialized model that is specifically tuned for use with watsonx Orchestrate.
|
Starting the IBM Events Operator in the operators project
5.2.05.2.1If you installed only the agentic
features of watsonx Orchestrate by setting watson_orchestrate_install_mode: lite ,
you must create an operand request in the operands project to start the IBM Events Operator(ibm-events-operator) in the
operators project.
cat <<EOF |oc apply -f -
apiVersion: operator.ibm.com/v1alpha1
kind: OperandRequest
metadata:
name: wo-operand-request
namespace: ${PROJECT_CPD_INST_OPERANDS}
spec:
requests:
- operands:
- name: ibm-events-operator-v5.1
registry: common-service
EOFInstalling the service
To install watsonx Orchestrate:
-
Log the
cpd-cliin to the Red Hat OpenShift Container Platform cluster:${CPDM_OC_LOGIN}Remember:CPDM_OC_LOGINis an alias for thecpd-cli manage login-to-ocpcommand. - Run the following command to create the required OLM objects for watsonx Orchestrate in the
operators project for the
instance:
cpd-cli manage apply-olm \ --release=${VERSION} \ --cpd_operator_ns=${PROJECT_CPD_INST_OPERATORS} \ --components=watsonx_orchestrateWait for thecpd-clito return the following message before you proceed to the next step:[SUCCESS]... The apply-olm command ran successfullyIf the
apply-olmfails, see Troubleshooting the apply-olm command during installation or upgrade. - Create the custom resource for watsonx Orchestrate.
The command that you run depends on the storage on your cluster.
Red Hat OpenShift Data Foundation storage
Run the appropriate command to create the custom resource.
- Default installation (without installation options)
-
cpd-cli manage apply-cr \ --components=watsonx_orchestrate \ --release=${VERSION} \ --cpd_instance_ns=${PROJECT_CPD_INST_OPERANDS} \ --block_storage_class=${STG_CLASS_BLOCK} \ --file_storage_class=${STG_CLASS_FILE} \ --license_acceptance=true - Custom installation (with installation options)
-
cpd-cli manage apply-cr \ --components=watsonx_orchestrate \ --release=${VERSION} \ --cpd_instance_ns=${PROJECT_CPD_INST_OPERANDS} \ --block_storage_class=${STG_CLASS_BLOCK} \ --file_storage_class=${STG_CLASS_FILE} \ --param-file=/tmp/work/install-options.yml \ --license_acceptance=true
IBM Fusion Data Foundation storage
Run the appropriate command to create the custom resource.
- Default installation (without installation options)
-
cpd-cli manage apply-cr \ --components=watsonx_orchestrate \ --release=${VERSION} \ --cpd_instance_ns=${PROJECT_CPD_INST_OPERANDS} \ --block_storage_class=${STG_CLASS_BLOCK} \ --file_storage_class=${STG_CLASS_FILE} \ --license_acceptance=true - Custom installation (with installation options)
-
cpd-cli manage apply-cr \ --components=watsonx_orchestrate \ --release=${VERSION} \ --cpd_instance_ns=${PROJECT_CPD_INST_OPERANDS} \ --block_storage_class=${STG_CLASS_BLOCK} \ --file_storage_class=${STG_CLASS_FILE} \ --param-file=/tmp/work/install-options.yml \ --license_acceptance=true
Portworx storage
Run the appropriate command to create the custom resource.
- Default installation (without installation options)
-
cpd-cli manage apply-cr \ --components=watsonx_orchestrate \ --release=${VERSION} \ --cpd_instance_ns=${PROJECT_CPD_INST_OPERANDS} \ --storage_vendor=portworx \ --license_acceptance=true - Custom installation (with installation options)
-
cpd-cli manage apply-cr \ --components=watsonx_orchestrate \ --release=${VERSION} \ --cpd_instance_ns=${PROJECT_CPD_INST_OPERANDS} \ --storage_vendor=portworx \ --param-file=/tmp/work/install-options.yml \ --license_acceptance=true
NetApp Trident
Remember: When you use NetApp Trident storage, both${STG_CLASS_BLOCK}and${STG_CLASS_FILE}point to the same storage class, typicallyontap-nas.Run the appropriate command to create the custom resource.
- Default installation (without installation options)
-
cpd-cli manage apply-cr \ --components=watsonx_orchestrate \ --release=${VERSION} \ --cpd_instance_ns=${PROJECT_CPD_INST_OPERANDS} \ --block_storage_class=${STG_CLASS_BLOCK} \ --file_storage_class=${STG_CLASS_FILE} \ --license_acceptance=true - Custom installation (with installation options)
-
cpd-cli manage apply-cr \ --components=watsonx_orchestrate \ --release=${VERSION} \ --cpd_instance_ns=${PROJECT_CPD_INST_OPERANDS} \ --block_storage_class=${STG_CLASS_BLOCK} \ --file_storage_class=${STG_CLASS_FILE} \ --param-file=/tmp/work/install-options.yml \ --license_acceptance=true
Validating the installation
apply-cr command
returns:[SUCCESS]... The apply-cr command ran successfully
If you want to confirm that the custom resource status is
Completed, you can run the cpd-cli
manage
get-cr-status command:
cpd-cli manage get-cr-status \
--cpd_instance_ns=${PROJECT_CPD_INST_OPERANDS} \
--components=watsonx_orchestrate
What to do next
- Complete the mandatory post-installation setup tasks. For more information, see Post-installation setup for watsonx Orchestrate.
- To enable the users to access watsonx Orchestrate, see Giving users access to a watsonx Orchestrate instance.