Preparing to install IBM watsonx.ai

Before you install the IBM watsonx.ai service, make sure that your cluster meets the system requirements for the IBM watsonx.ai service depending on the installation mode you use and the models you choose to install.

  1. Choose whether to install the full service or watsonx.ai lightweight engine.

    For more information, see Choosing an IBM watsonx.ai installation mode.

  2. Choose the foundation models that you want to install.

    For more information about the available foundation models, see Supported foundation models. You can also bring you own custom foundation models after the service is installed.

  3. Gather the extra resources that are needed to support hosting foundation models for inferencing, including specialized GPUs.

    The number and size of GPUs required depends on the foundation models that you want to install. See Foundation models in IBM watsonx.ai.