Upgrading Netcool Operations Insight on Red Hat OpenShift Container Platform with the Operator Lifecycle Manager (OLM) user interface

Use these instructions to upgrade an existing Netcool® Operations Insight® deployment from version 1.6.12 or version 1.6.11 to version 1.6.13, with the Red Hat® OpenShift® Container Platform Operator Lifecycle Manager (OLM) user interface (UI). Before you upgrade, you must back up your deployment.

Before you begin

  • Note: Upgrading from OwnNamespace mode to SingleNamespace mode is not supported. The SingleNamespace mode is supported only for cloud and hybrid deployments that are installed with the oc-ibm_pak plug-in and portable compute or portable storage devices..
  • Ensure that you complete all the steps in Preparing your cluster. Most of these steps were completed as part of your previous Netcool Operations Insight deployment.
  • Ensure that you have an adequately sized cluster. For more information, see Sizing for a Netcool Operations Insight on Red Hat OpenShift deployment.
  • Configure persistent storage for your deployment. Only version 1.6.12 or version 1.6.11 deployments with persistence enabled are supported for upgrade to version 1.6.13.
  • Note: Before you upgrade to version 1.6.13, if present, remove the noi-root-ca secret by running the following command:
    oc delete secret noi-root-ca
  • Before you upgrade, save a backup copy of the cloud native analytics gateway configmap: ea-noi-layer-eanoigateway. For more information, see Preserving cloud native analytics gateway configmap customizations on upgrade.

If you want to verify the origin of the catalog, then use the OLM UI and CASE upgrade method instead. For more information, see Upgrading IBM Netcool Operations Insight on Red Hat OpenShift with the oc ibm-pak plug-in and Container Application Software for Enterprises (CASE).

All the necessary images for version 1.6.13 are either in the freely accessible operator repository (icr.io/cpopen), or in the IBM Entitled Registry (cp.icr.io) for which you need an entitlement key.

To upgrade from version 1.6.12 or 1.6.11 to version 1.6.13, complete the following steps.

Procedure

Upgrade the catalog source

  1. From the Red Hat OpenShift Container Platform OLM UI, go to Administration > Cluster Settings. Then, go to the Configurations tab and select the OperatorHub configuration resource.
  2. Under the Sources tab, click the existing Netcool Operations Insight catalog source, ibm-operator-catalog.
  3. Confirm that the catalog source name and image for version 1.6.13, icr.io/cpopen/ibm-operator-catalog:latest, is specified in the catalog source YAML. If necessary, update the spec.image value to icr.io/cpopen/ibm-operator-catalog:latest and select Save.
    Note: When you installed version 1.6.12 or version 1.6.11, you specified icr.io/cpopen/ibm-operator-catalog:latest as the catalog source name and image. For more information, see step 1b in Installing Netcool Operations Insight with the Operator Lifecycle Manager (OLM) user interface for version 1.6.12, or step 1b in Installing Netcool Operations Insight with the Operator Lifecycle Manager (OLM) user interface for version 1.6.11.

Upgrade the Netcool Operations Insight operator

  1. To upgrade the operator from the OLM UI, go to Operators > Installed Operators > IBM Cloud Pak for AIOps Event Manager. Go to the Subscription tab.
    • Select v1.17 in the Update channel section.
    Note: It takes a few minutes for IBM Cloud Pak for AIOps Event Manager to install. When installed, ensure that the status of IBM Cloud Pak for AIOps Event Manager is Succeeded before you proceed to the next steps.

Upgrade the Netcool Operations Insight instance

  1. Note: Complete this step if you are upgrading from version 1.6.11 to version 1.6.13.
    To avoid issues with CouchDB or Redis pods after upgrade, complete the following steps.
    If your deployment has more than one CouchDB replica, for example a production size deployment, scale the CouchDB statefulset to zero.
    oc scale sts <release-name>-couchdb --replicas=0
    Scale the Redis statefulset to zero.
    oc scale sts <release-name>-ibm-redis-server --replicas=0
  2. Upgrade the Netcool Operations Insight instance by going to the OLM UI. Go to Operators > Installed Operators and select your project. Then select IBM Cloud Pak for AIOps Event Manager.
  3. Note: Complete this step if you are upgrading from version 1.6.11.
    Go to the All instances or NOI tab and select your instance. Edit the YAML.
    • Update the spec.version value (from 1.6.11) to spec.version: 1.6.13.
    Note: To avoid an imagepullbackoff error after an upgrade, edit the cemformation. For more information, see Migration job does not complete.
  4. Note: Complete this step if you are upgrading from version 1.6.12.
    Go to the All instances or NOI tab and select your instance. Edit the YAML.
    1. Update the spec.version value (from 1.6.12) to spec.version: 1.6.13.
    2. Add the following settings for the helmValuesCEM section.
      spec:
        helmValuesCEM:
          commonimages.brokers.image.digest: sha256:d40731e355dd6a28cef6224f788b5456c94df7556eba1babc51ce5e9ac2784da
          commonimages.brokers.image.tag: 1.15.0-20240307T210317Z-multi-arch-L-KBDX-JKT9JU
          commonimages.cemusers.image.digest: sha256:8c6a4f119270029982cac2206aaa433118d3d0f04738bbf220abf73c2de21798
          commonimages.cemusers.image.tag: 1.15.0-20240307T210317Z-multi-arch-L-KBDX-JKT9JU
          commonimages.channelservices.image.digest: sha256:3b64430b32787ae03ec88b409e8fd720d619b214ff2c4c1947bf26300139ee1a
          commonimages.channelservices.image.tag: 1.15.0-20240307T210317Z-multi-arch-L-KBDX-JKT9JU
          commonimages.eventanalyticsui.image.digest: sha256:bee1274a8fe0d3015425bdd13c09d9faec26885f343da6720e17f7a5c37b27eb
          commonimages.eventanalyticsui.image.tag: 1.15.0-20240307T210322Z-multi-arch-L-KBDX-JKT9JU
          commonimages.eventpreprocessor.image.digest: sha256:0066b6d6b28b1c70552c86e4c13aa752f865608fba368057e724d8ce98820b68
          commonimages.eventpreprocessor.image.tag: 1.15.0-20240307T210317Z-multi-arch-L-KBDX-JKT9JU
          commonimages.incidentprocessor.image.digest: sha256:4ef66e6932b362c56d2a7fbe5e789a364ef8ef960c8100f3bf4a09fe11a58bb0
          commonimages.incidentprocessor.image.tag: 1.15.0-20240307T210317Z-multi-arch-L-KBDX-JKT9JU
          commonimages.notificationprocessor.image.digest: sha256:d875654db5b60fd9727bddca4c4da8539d2fb20c872fc83496e2acfeaa2d28e2
          commonimages.notificationprocessor.image.tag: 1.15.0-20240307T210317Z-multi-arch-L-KBDX-JKT9JU
          commonimages.integrationcontroller.image.digest: sha256:7f82bad08d6c51fff865f74551466027e36bc39cbd7bbed9481a134881063165
          commonimages.integrationcontroller.image.tag: 1.15.0-20240307T210317Z-multi-arch-L-KBDX-JKT9JU
          commonimages.normalizer.image.digest: sha256:af550c0e3cd2d2c239556c9175198e9f5a4561999f059841c79a98c838e3801b
          commonimages.normalizer.image.tag:   1.15.0-20240307T210317Z-multi-arch-L-KBDX-JKT9JU
          commonimages.rba.rbs.image.digest: sha256:2e82106c4be36dddc03132d8e74eec11cc5de1624d3bf73a3a12d2cf29cbe5d8
          commonimages.rba.rbs.image.tag: 1.34.0-20240305124329-ubi8-minimal-L-KBDX-JKT9JU
          commonimages.rba.as.image.digest: sha256:937c4ac77690670e1eee409ae514d7c880a66b7e70b1cf1c55091e64cdd6e506
          commonimages.rba.as.image.tag: 1.34.0-20240301170623-ubi8-minimal-L-KBDX-JKT9JU
      Wait for all pods, except for the CEM pods, to restart and all jobs to complete. Then, edit the YAML file and remove the helmValuesCEM section. The CEM pods will restart.
    Note: To avoid an imagepullbackoff error after an upgrade, edit the cemformation. For more information, see Migration job does not complete.
  5. Select Save and wait until all pods are restarted. You can monitor progress from the Red Hat OpenShift Container Platform UI.

What to do next

If the {{ .Release.Name }}-spark-shared-state PVC is included after the upgrade, you can delete it. This PVC is not used in Netcool Operations Insight 1.6.13 and onward.
  1. Check whether a shared spark PVC exists:
    oc get pvc | grep 'spark'
  2. Delete the {{ .Release.Name }}-spark-shared-state PVC resource if it is included:
    oc delete pvc {{ .Release.Name }}-spark-shared-state
    Where {{ .Release.Name }} is the release name of the PVC resource.

After you upgrade your cloud deployment, update the cloud native analytics gateway configmap. For more information, see Preserving cloud native analytics gateway configmap customizations on upgrade.

To enable or disable an observer, use the oc patch command, as in following example:
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/netDisco", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/aaionap", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/alm", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/ansibleawx", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/appdynamics", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/aws", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/azure", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/bigcloudfabric", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/bigfixinventory", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/cienablueplanet", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/ciscoaci", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/contrail", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/dns", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/docker", "value": 'true' }]'	
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/dynatrace", "value": 'true' }]'		
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/file", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/gitlab", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/googlecloud", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/hpnfvd", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/ibmcloud", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/itnm", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/jenkins", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/junipercso", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/kubernetes", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/newrelic", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/openstack", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/rancher", "value": 'true' }]'	
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/rest", "value": 'true' }]'						
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/sdconap", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/servicenow", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/sevone", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/taddm", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/viptela", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/vmvcenter", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/vmwarensx", "value": 'true' }]'
oc patch noi $noi_instance_name -n $NAMESPACE --type='json' -p='[{"op": "replace", "path": "/spec/topology/observers/zabbix", "value": 'true' }]'	

If you don't want to roll back to a previous version, remove the nasm-elasticsearch and common-datarouting pods from your full cloud 1.6.13 deployment. For more information, see Postupgrade task.