Online installation toolkit upgrade

From IBM Storage Scale 5.0.5.1 and BDA integration 1.0.1.1, the installation toolkit supports the CES HDFS Transparency online upgrade.

  1. After the IBM Storage Scale install package is extracted, starting from IBM Storage Scale 5.0.5.1 with Toolkit for HDFS at 1.0.1.1 and HDFS Transparency 3.1.1-1, the default location (/usr/lpp/mmfs/5.0.5.1/) for the files will contain the correct packages to do the online upgrade. Ensure that the HDFS Transparency and Toolkit for HDFS residing in /usr/lpp/mmfs/<Scale version>/hdfs_rpms/rhel7/hdfs_3.1.1.x (default Red Hat® location) have the support combination versions as stated in the CES HDFS HDFS Transparency support matrix section.
  2. For IBM Storage Scale 5.1.1 and later:
    # cd /usr/lpp/mmfs/5.1.1.0/ansible-toolkit
    For IBM Storage Scale 5.1.0 and earlier:
    # cd /usr/lpp/mmfs/5.0.5.1/installer
    Run the following command:
    # ./spectrumscale setup -s <Installer IP>

    For IBM Storage Scale System:

    # ./spectrumscale setup -s <EMS Node> -st ess
  3. Populate the existing configuration:
    # ./spectrumscale config populate -N < HDFS Node>
    Where HDFS NODE is any node in the HDFS Transparency cluster.
    For example:
    ./spectrumscale config populate -N c902f09x11.gpfs.net 
    
  4. The installation toolkit automatically updates only the HDFS package when HDFS protocol is enabled in the toolkit. To check if HDFS is enabled, run the following command:
    ./spectrumscale node list
  5. Run upgrade precheck.
    # ./spectrumscale upgrade precheck
  6. Deploy the upgrade if the precheck is successful.
    # ./spectrumscale upgrade run
For more information about the installation toolkit online upgrade process, see the following topics in the IBM Storage Scale: Concepts, Planning, and Installation Guide:
  • Upgrading IBM Storage Scale components with the installation toolkit
  • Upgrade process flow
  • Performing online upgrade by using the installation toolkit
For CES HDFS, the online upgrade flow is as follows:
Online upgrade flow

Verification script

A verification script is available at /usr/lpp/mmfs/hadoop/dependency/verify_dependency.sh. Use this verification script to confirm the presence of dependency JAR files on the HDFS nodes.