Menu items in Web GUI can disappear if primary and backup clusters fail

In a geo-redundancy enabled full cloud environment, if both primary and backup clusters are down, then the menu items in Web GUI might not appear.

Problem

In a geo-redundancy enabled full cloud deployment, if the primary cluster is down and the Web GUI pod on the backup cluster is restarted during the failover state, then the menu items in Web GUI might disappear.

Resolution

The backup Web GUI pod must not be restarted while the primary cluster or the primary Web GUI pod is down, as this activity would result in downtime of the entire service. However, in the rare event where the backup Web GUI pod needs restarting while the primary cluster is down, make the following changes temporarily.

  1. On the backup cluster, edit the Web GUI statefulset.
    oc edit sts <backup_releasename>-webgui
    Where <backup_releasename> is the name of your Netcool® Operations Insight® on Red Hat® OpenShift® deployment on the backup cluster.
  2. Switch the NCO_AGGP_SERVICE_NAME and NCO_AGGB_SERVICE_NAME entries as follows:
     containers:
         - env:
           - name: LICENSE
             value: accept
           - name: NCO_AGGP_SERVICE_NAME
             value: <backup_releasename>-objserv-agg-backup
           - name: NCO_AGGP_PORT_NUMBER
             value: "4100"
           - name: NCO_AGGB_SERVICE_NAME
             value: <primary_releasename>-objserv-agg-primary
           - name: NCO_AGGB_PORT_NUMBER
             value: "4100"
    Where:
    • <backup_releasename> is the name of your Netcool Operations Insight on Red Hat OpenShift deployment on the backup cluster.
    • <primary_releasename> is the name of your Netcool Operations Insight on Red Hat OpenShift deployment on the primary cluster.
  3. Revert the changes that were made to the Web GUI statefulset in step 2 after the primary cluster or the primary Web GUI pod and the ncoprimary pod are back up again.