Installing operators for services that require GPUs

If you plan to install services that require graphics processing units (GPUs), you must install several operators that support the management of the NVIDIA software components that are needed to provision GPUs.

Installation phase
  • You are not here. Setting up a client workstation
  • You are not here. Setting up a cluster
  • You are not here. Collecting required information
  • You are not here. Preparing to run installs in a restricted network
  • You are not here. Preparing to run installs from a private container registry
  • You are here icon. Preparing the cluster for IBM® Software Hub
  • You are not here. Preparing to install an instance of IBM Software Hub
  • You are not here. Installing an instance of IBM Software Hub
  • You are not here. Setting up the control plane
  • You are not here. Installing solutions and services
Who needs to complete this task?

Cluster administrator A cluster administrator must complete this task.

When do you need to complete this task?
One-time setup Complete this task if you plan to install one or more of the following services:
  • IBM Knowledge Catalog Premium
  • IBM Knowledge Catalog Standard
  • Watson Machine Learning (required to use optional GPU features)
  • Watson Studio Runtimes (required to use runtimes that require GPU)
  • watsonx.ai™
  • watsonx Assistant (required to use optional GPU features)
  • watsonx Code Assistant™
  • watsonx Code Assistant for Red Hat® Ansible® Lightspeed
  • watsonx Code Assistant for Z
  • watsonx Code Assistant for Z Code Explanation
  • watsonx.data™ (required to use Milvus indexes that require GPU)
  • watsonx™ Orchestrate

About this task

Review the following table to determine which operators you must install based on the services that you plan to install:

Service Node Feature Discovery Operator NVIDIA GPU Operator
IBM Knowledge Catalog Premium ✓ ✓
IBM Knowledge Catalog Standard ✓ ✓
Watson Machine Learning Required to use deep learning or models that require GPU. Required to use optional GPU features.
Watson Studio Runtimes Required to use optional runtimes that require GPU. Required to use optional runtimes that require GPU.
watsonx.ai ✓ ✓
watsonx Assistant Required to use optional GPU features. Required to use optional GPU features.
watsonx Code Assistant ✓ ✓
watsonx Code Assistant for Red Hat Ansible Lightspeed ✓ ✓
watsonx Code Assistant for Z ✓ ✓
watsonx Code Assistant for Z Code Explanation ✓ ✓
watsonx.data Required to use Milvus indexes that require GPU Required to use Milvus indexes that require GPU
watsonx Orchestrate ✓ ✓

Procedure

The steps that you must complete depend on whether your cluster is connected to the internet:

  1. To install the operators on a cluster that can connect to the internet:
    1. Complete Installing the Node Feature Discovery (NFD) Operator in the NVIDIA GPU Operator on Red Hat OpenShift® Container Platform documentation.
    2. Complete Installing the NVIDIA GPU Operator in the NVIDIA GPU Operator on Red Hat OpenShift Container Platform documentation.
  2. To install the operators on a cluster that is disconnected or air-gapped:
    1. Complete Deploy GPU Operators in a disconnected or air-gapped environment in the NVIDIA GPU Operator on Red Hat OpenShift Container Platform documentation.

What to do next

Now that you've installed the operators for services that require GPUs, you're ready to complete Installing Red Hat OpenShift AI.

You can optionally complete Configuring NVIDIA Multi-Instance GPU (MIG) if your environment includes services that support MIG.