Troubleshooting issue related to Managed services after upgrading from 2.1.x to 2.2.y

Symptom

There are multiple CSVs for infra-vm or other Managed services submodules after upgrading IBM Cloud Pak® for Multicloud Management from 2.1.x to 2.2.y. You can verify this by using the following command:

oc get csv -n management-infrastructure-management

Resolving the problem

  1. Check the subscriptions in the management-infrastructure-management namespace. If there are multiple subscriptions for the same package, you must delete these extra subscriptions. For example,

    oc get subs -n management-infrastructure-management
    
    NAME                                                                              PACKAGE                          SOURCE                   CHANNEL
    ibm-management-cam-install                                                        ibm-management-cam-install       ibm-management-catalog   2.2-candidate
    ibm-management-im-install                                                         ibm-management-im-install        ibm-management-catalog   2.2-candidate
    ibm-management-infra-grc                                                          ibm-management-infra-grc         ibm-management-catalog   2.2-candidate
    ibm-management-infra-vm                                                           ibm-management-infra-vm          ibm-management-catalog   2.2-candidate
    ibm-management-infra-vm-2.2-fast-ibm-management-catalog-openshift-marketplace     ibm-management-infra-vm          ibm-management-catalog   2.2-fast
    ibm-management-infra-vm-2.2-stable-ibm-management-catalog-openshift-marketplace   ibm-management-infra-vm          ibm-management-catalog   2.2-stable
    ibm-management-service-library                                                    ibm-management-
    
  2. If the output has similar names with different versions, you need to delete the subscriptions with long names. In this example you need to delete the following:

    oc delete sub ibm-management-infra-vm-2.2-fast-ibm-management-catalog-openshift-marketplace -n management-infrastructure-management
    
    oc delete sub ibm-management-infra-vm-2.2-stable-ibm-management-catalog-openshift-marketplaceibm
    
  3. Delete the old CSVs for the package with multiple subscriptions (in this case infra-vm).

    oc get csv -n management-infrastructure-management
    

    Output:

    NAME                                                 DISPLAY                                              VERSION              REPLACES                                             PHASE
    ibm-common-service-operator.v3.6.1                   IBM Cloud Platform Common Services                   3.6.1                ibm-common-service-operator.v3.6.0                   Succeeded
    ibm-management-cam-install.v2.2.4-202012011117       IBM Management Infrastructure managed services       2.2.4-202012011117   ibm-management-cam-install.v2.2.3-202011251235       Replacing
    ibm-management-cam-install.v2.2.5-202012021409       IBM Management Infrastructure managed services       2.2.5-202012021409   ibm-management-cam-install.v2.2.4-202012011117       Installing
    ibm-management-hybridapp.v2.2.5-202012021409         IBM Management Hybrid Applications                   2.2.5-202012021409   ibm-management-hybridapp.v2.2.4-202012011117         Succeeded
    ibm-management-im-install.v2.2.4-202012011117        IBM Management Infrastructure install                2.2.4-202012011117   ibm-management-im-install.v2.2.3-202011251235        Installing
    ibm-management-im-install.v2.2.5-202012021409        IBM Management Infrastructure install                2.2.5-202012021409   ibm-management-im-install.v2.2.4-202012011117        Failed
    ibm-management-infra-grc.v2.2.5-202012021409         IBM Management Infrastructure for Hybrid GRC         2.2.5-202012021409   ibm-management-infra-grc.v2.2.4-202012011117         Succeeded
    ibm-management-infra-vm.v2.2.4-202012011117          IBM Management Infrastructure for virtual machines   2.2.4-202012011117   ibm-management-infra-vm.v2.2.3-202011251235          Succeeded
    ibm-management-infra-vm.v2.2.5-202012021409          IBM Management Infrastructure for virtual machines   2.2.5-202012021409   ibm-management-infra-vm.v2.2.4-202012020117          Failed
    ibm-management-orchestrator.v2.2.5-202012021409      IBM Cloud Pak for Multicloud Management              2.2.5-202012021409   ibm-management-orchestrator.v2.2.4-202012011117      Succeeded
    ibm-management-service-library.v2.2.4-202012011117   IBM Management Service Library                       2.2.4-202012011117   ibm-management-service-library.v2.2.3-202011251235
    ibm-management-service-library.v2.2.5-202012021409   IBM Management Service Library                       2.2.5-202012021409   ibm-management-service-library.v2.2.4-202012011117   Succeeded
    

    Delete this older infra-vm CSV ibm-management-infra-vm.v2.2.4-202012011117 -n management-infrastructure-management:

    oc delete csv ibm-management-infra-vm.v2.2.4-202012011117 -n management-infrastructure-management
    
  4. Wait to see whether things resolve (for 10-20m). If there are still older CSVs for other submodules in the management-infrastructure-management namespace, delete those as well. For example,:

    oc delete csv ibm-management-cam-install.v2.2.4-202012011117 -n management-infrastructure-management
    
    oc delete csv ibm-management-im-install.v2.2.4-202012011117 -n management-infrastructure-management
    
    oc delete csv ibm-management-service-library.v2.2.4-202012011117 -n management-infrastructure-management