IBM Support

Errors observed when installing watsonx.ai LLMs into a IBM Cloud Pak® for Data 5.0 cluster

Troubleshooting


Problem

You are upgrading your IBM Cloud Pak® for Data environment to version 5.0 and have decided to add the watsonx.ai service to leverage the Large Language Models (LLM) available. You follow the IBM Documentation to install the watsonx.ai service, which was successful. You then attempt to install one (or more) of the LLM's but this fail with the message:
The conditional check 'isvc_info is defined and isvc_info.resources[0].status.modelStatus.copies.failedCopies == 1' failed. The error was: error while evaluating conditional ... 'dict.object' has no attribute 'status'. 'dict.object' has no attribute 'status'.
The error appears to be in '/opt/ansible/0.0.0/roles/watsonxaiifm/tasks/wait-for-model-isvc.yml': line 32, column 3, but may be elsewhere in the file depending on the exact syntax problem.

The offering line appears to be:
- name: Update install_model_list if inference-service failed
^ here
Unknown playbook failure

Symptom

Symptoms for this issue include observing the watsonx_ai_ifm service is always in an InProgress status when you run the following:
oc get Watsonxaiifm watsonxaiifm-cr -oyaml | grep watsonxaiifmStatus
When removing LLM's from the cluster, the watsonxaiifmStatus is shown as Completed. As soon as any model is attempted to be installed, it reverts back to InProgress.

Document Location

Worldwide

[{"Type":"MASTER","Line of Business":{"code":"LOB10","label":"Data and AI"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSGU851","label":"IBM Watson Studio for IBM Cloud Pak for Data"},"ARM Category":[{"code":"a8m3p000000UoS7AAK","label":"Installation-\u003EConfiguration"}],"ARM Case Number":"TS016565472","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"All Versions"}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Document Information

Modified date:
11 July 2024

UID

ibm17160115