PowerVC offline upgrade

The PowerVC Operations Manager (OpsMgr) is a collection of utilities and services that are designed to facilitate user operation of PowerVC clusters like install, upgrade, backup, and restore. In a multinode (HA) environment, all nodes can now be updated while services are offline. Update happens simultaneously on all nodes.

This topic explains the procedure for offline upgrading of opsmgr utility and PowerVC on single node and multinode.

Note: Direct offline upgrade from PowerVC 2.2.0 to PowerVC 2.3.0 is not supported.
For RHEL
For SLES
  • Direct offline upgrade to PowerVC 2.3.0 is not supported. However, you can upgrade to PowerVC 2.3.0 by using backup and restore . For more information about backup, see Backing up. For more information about restore, see Restoring to PowerVC version 2.3.0.

Prerequisites

  • Before upgrading, make sure that the cluster is in sync and the RabbitMQ service is running by executing these commands.
    • # clustercheck
    • # service rabbitmq-server status
  • It is recommended to update the operating system distribution before you upgrade to PowerVC 2.3.0, or later versions. If the operating system distribution is not updated before the update process, then it is mandatory to update the OpenSSH server to the latest version.
    Note: If the OpenSSH server is not updated to the latest version, it might lead to issues during the upgrade process.
    Before you proceed with PowerVC upgrade, perform the following steps to update the OpenSSH server to the latest version:
    1. Run the following command:
      yum update openssh-server
    2. Restart the SSHD service.
Notes:
  • Manually take a backup of existing PowerVC, before you upgrade opsmgr utility.
  • Before you upgrade to PowerVC version 2.3.0, migrate any hosts that runs on Compute plane node to PowerVC controller by using the /opt/ibm/powervc/bin/powervc-manage -o migratehmchost --hmchostname <MTMS HOST> command. After upgrade process is complete, you can migrate the hosts back to Compute plane node by using the /opt/ibm/powervc/bin/powervc-manage -o migratehmchost --hmchostname <MTMS HOST> command.
Notes:
  • If upgrade is interrupted at any point for various reasons, you can always re-trigger the upgrade procedure.
  • If network disconnections are expected, try to upgrade by using nohup command.
  • PowerVC is not accessible when upgrade is in progress.

Upgrading opsmgr utility

  1. Visit Fix Central to download and install any fix packs that are available. For more information see the Getting fixes from Fix Central topic.
  2. Extract the tar file that matches your environment to the location you want to run the installation script from:
    • Upgrading to PowerVC 2.3.0 from PowerVC 2.2.1 or 2.2.1.1 versions

      For ppc64le, extract download_location/powervc-opsmgr-<rhel or sles>-ppcle-2.3.0.tgz, where download_location is the directory where the tar file was downloaded to.

      For x86_64, extract the download_location/powervc-opsmgr-rhel-x86-2.3.0.tgz, where download_location is the directory where the tar file was downloaded to.

  3. Change the directory to: extract location/powervc-opsmgr-2.3.0, where extract location is the directory you extracted the tar file to in step 2.
  4. To upgrade from 2.2.1 or 2.2.1.1 versions to 2.3.0, run update_opsmgr.sh script on the primary or bootstrap node.

    Alternatively, you can run <path>/update_opsmgr.sh -s to perform silent installation.

Upgrading PowerVC on single node or multinode

After upgrading OpsMgr, you can upgrade PowerVC on single node and later add multiple nodes (up to five nodes) if needed.
Notes:
Run powervc-opsmgr update -o/--offline-mode -c/--cluster <cluster_name> on primary / bootstrap node to upgrade.
Notes:
  • If there are any deploy failures post PowerVC update, it is recommended to restart PowerVC services and retry deploy operation.
  • After the upgrade is complete, and you see the host state as unknown, check if IPv6 is enabled in the node by running the sysctl -a 2>/dev/null | grep disable_ipv6 command. If IPv6 is enabled, disable IPv6 in all the nodes by running the sudo sysctl -w -p net.ipv6.conf.all.disable_ipv6=1 command, and then reboot the system.
  • Occasionally, after an upgrade, the virtual IP might become unreachable. You can confirm if the virtual IP is reachable or not by a ping test. This issue might occur due to an IP conflict or high load during the upgrade. If this issue occurs, run crm_resource -r virtualip --restart command after the upgrade to reactivate the virtual IP.\