Preparing your system to use watsonx Assistant for Z

Before you install watsonx Orchestrate, ensure that you fulfill the following prerequisites and cluster requirements.

Prerequisites

Client workstation - cpd-cli and Red Hat OpenShift console
Red Hat OpenShift Data Foundation or other supported storage
For information on the supported storage types, see Installing watsonx Orchestrate.
Ensure that you enable the data encryption at rest by selecting the Cluster-wide encryption setting when creating a storage cluster with Red Hat OpenShift data foundation. For more information, see Creating OpenShift Data Foundation cluster on any platform.
Cloud Pak for Data - Foundational services including control plane
GPU prerequisites – NVIDIA GPU Operator, Red Hat OpenShift AI, and Node Feature Discovery Operator

Minimum infrastructure requirements up to 50 concurrent accesses

The following table provides minimum infrastructure requirements up to 50 concurrent accesses.

Note: Concurrent accesses are the number of queries or automation that run simultaneously.

Environment	IBM Cloud with Bring Your own License (BYOL)	Number of Instances
GPU (L40s) Note: A100 and H100 GPUs are also supported.	2	2
vCPU	96	120
Memory	432 GB	528 GB
Filesystem storage	3.2 TB	4.4 TB
Block storage	800 GB	1.1 TB

Minimum infrastructure requirements on IBM Cloud up to 50 concurrent accesses

The following table provides minimum infrastructure requirements up to 50 concurrent accesses for IBM cloud.

Environment	Configuration name	Number of Instances
GPU nodes	gx3.24x120.L40s NVIDIA L40s 24 vCPUs 120 GB memory 400 GB Filesystem Storage +10/IOPs/GB Network speed - 32 Gbps	2
Worker Nodes (ROKS clusters)	bx2.8x32 8 vCPUs 32 GB memory 400 GB Filesystem Storage +10/IOPs/GB Network speed 16 Gbps	6
Block storage	100 GB + 10/IOPs/GB	8

Minimum infrastructure requirements for on-prem environment up to 50 concurrent accesses

The following table provides minimum infrastructure requirements up to 50 concurrent accesses for an on-prem environment.

Environment	Resources per node	Number of Instances
GPU nodes Note: A100 and H100 GPUs are also supported.	NVIDIA L40s 24 vCPUs 120 GB memory 400 GB Filesystem Storage +10/IOPs/GB Network speed - 32 Gbps	2
Nodes	8 vCPUs 32 GB memory 400 GB Filesystem Storage Network speed - 16 Gbps	9 (3 master and 6 worker nodes)
Block storage	100 GB + 10/IOPs/GB	11

Minimum infrastructure requirements for IBM cloud and on-prem environments up to 50 concurrent accesses (Hybrid)

The following table provides minimum infrastructure requirements up to 50 concurrent accesses for IBM cloud and on-prem environments.

Environment	Resources required per instance	Number of Instances
GPU nodes Note: A100 and H100 GPUs are also supported.	NVIDIA L40s 24 vCPUs 120 GB memory 400 GB Filesystem Storage Network speed - 32 Gbps	2 Note: Runs on x86 for both on-prem and IBM Cloud.
Nodes	8 vCPUs 32 GB memory 400 GB Filesystem Storage Network speed - 16 Gbps	9 (3 master and 6 worker nodes) Note: Runs on 390x. At least 8 IFLs are required.
Block storage	100 GB + 10/IOPs/GB	11