IBM Support

Readme and Release notes for release 5.0.5.0 IBM Spectrum Scale 5.0.5.0 Spectrum_Scale_Data_Management-5.0.5.0-x86_64-Linux Readme

Fix Readme


Abstract

xxx

Content

Readme file for: Spectrum Scale
Product/Component Release: 5.0.5.0
Update Name: Spectrum_Scale_Data_Management-5.0.5.0-x86_64-Linux
Fix ID: Spectrum_Scale_Data_Management-5.0.5.0-x86_64-Linux
Publication Date: 22 May 2020
Last modified date: 22 May 2020

Installation information

Download location

Below is a list of components, platforms, and file names that apply to this Readme file.

Fix Download for Linux

Product/Component Name: Platform: Fix:
IBM Spectrum Scale Linux 64-bit,x86_64 RHEL
Linux 64-bit,x86_64 SLES
Linux 64-bit,x86_64 Ubuntu
Spectrum_Scale_Data_Management-5.0.5.0-x86_64-Linux

Prerequisites and co-requisites

  • - Prerequisites

    You may use this 5.0.5.0 package to perform a First Time Install or to upgrade from an existing 4.2.0.0 - 5.0.4.4 (If upgrading node by node ) or 3.5.0 - 5.0.4.4 (If you shutdown and upgrade the entire cluster).

Known issues

  • - Problems discovered in IBM Spectrum Scale releases

    None.

Installation information

  • - Downloading Images

    Choose the download option "Download using Download Director" to download the new Spectrum Scale package and place it in any location desired on the install node.
    Note, if you must (not recommended) use download option "Download using your browser (HTTPS)", instead of clicking on the down arrow to the left of the package name, you must right-click on the package name and select the Save Link As.. option. If you just click on the download arrow, the browser will likely hang.

  • - Installing IBM Spectrum Scale update for System x

    After you have downloaded the IBM Spectrum Scale 5.0.5.0 update, follow the steps below to install the fix package:

    1. Ensure the package is executable using ls -l command.

      You should see something similar with permissions like:
           -rwx r--r-- l root root 110885866 Apr 27 15:52 /download_dir/package_name.

      If it's not executable, you can always make the package executable using the following command:
           chmod +x /download_dir/package_name
    2. Extract RPMs and Debian Linux packages from Self Extracting Package downloaded using following commands:

      For Standard Edition:

      ./Spectrum_Scale_Standard-5.0.5.0-x86_64-Linux-install

      For Advanced Edition:

      ./Spectrum_Scale_Advanced-5.0.5.0-x86_64-Linux-install

      For Data Management Edition:

      ./Spectrum_Scale_Data_Management-5.0.5.0-x86_64-Linux-install

      For Data Access Edition:

      ./Spectrum_Scale_Data_Access-5.0.5.0-x86_64-Linux-install

      Optional Package for SLES and RedHat Enterprise Linux:

      • gpfs.docs-5.0.5-0.noarch.rpm
      • gpfs.gss.pmcollector-5.0.5-0.xxx.*.rpm (where xxx is the OS version)
      • gpfs.gss.pmsensors-5.0.5-0.xxx.*.rpm (where xxx is the OS version)
      • gpfs.gui-5.0.5-0.noarch.rpm
      • gpfs.java-5.0.5-0.*.rpm
      • gpfs.callhome-5.0.5-0.xxx.noarch.rpm (where xxx is the OS type)
      • gpfs.callhome-ecc-client-5.0.5-0.noarch.rpm
      • gpfs.kafka-5.0.5-0.*.rpm (x86_64 only)
      • gpfs.librdkafka-5.0.5-0.*.rpm (x86_64 only)
      • gpfs.hdfs-protocol-2.7.3.*.rpm (x86_64, ppc64, and ppc64le only)
      • gpfs.hdfs-protocol-3.0.0.*.rpm (x86_64, ppc64, and ppc64le only)
      • gpfs.hdfs-protocol-3.1.*.rpm (x86_64, ppc64, and ppc64le only)
      • gpfs.tct.client-1.1.8*.rpm (IBM Spectrum Scale Advanced or Data Management Edition only, x86_64 and ppc64le only)
      • gpfs.tct.server-1.1.8*.rpm (IBM Spectrum Scale Advanced or Data Management Edition only, x86_64 and ppc64le only)

      Optional Package for Ubuntu Linux:

      • gpfs.docs_5.0.5-0_all.deb
      • gpfs.gui_5.0.5-0_all.deb
      • gpfs.java_5.0.5-0_*.deb
      • gpfs.callhome_5.0.5-0_all.deb (x86_64 only)
      • gpfs.callhome-ecc-client_5.0.5-0_all.deb (x86_64 only)
      • gpfs.kafka_5.0.5-0_*.deb (x86_64 only)
      • gpfs.librdkafka_5.0.5-0_*.deb (x86_64 only)
      • gpfs.gss.pmcollector_5.0.5-0.xxx_*.deb (where xxx is the OS version)
      • gpfs.gss.pmsensors_5.0.5-0.xxx_*.deb (where xxx is the OS version)
      • gpfs.tct.client-1.1.8*.deb (IBM Spectrum Scale Advanced or Data Management Edition only, x86_64 only)
    3. Follow the installation and migration instructions in your IBM Spectrum Scale Installing and upgrading.
  • - Upgrading GPFS nodes

    In the below instructions, node-by-node upgrade cannot be used to migrate from GPFS 4.1 or prior releases. For example, upgrading from 4.1.1.16 to 5.0.5.0 requires complete cluster shutdown, upgrade install on all nodes and then cluster startup.

    Upgrading GPFS may be accomplished by either upgrading one node in the cluster at a time or by upgrading all nodes in the cluster at once. When upgrading GPFS one node at a time, the below steps are performed on each node in the cluster in a sequential manner. When upgrading the entire cluster at once, GPFS must be shutdown on all nodes in the cluster prior to upgrading.

    When upgrading nodes one at a time, you may need to plan the order of nodes to upgrade. Verify that stopping each particular machine does not cause quorum to be lost or that an NSD server might be the last server for some disks. Upgrade the quorum and manager nodes first. When upgrading the quorum nodes, upgrade the cluster manager last to avoid unnecessary cluster failover and election of new cluster managers.

    1. Prior to upgrading GPFS on a node, all applications that depend on GPFS (e.g. DB2) must be stopped. Any GPFS file systems that are NFS exported must be unexported prior to unmounting GPFS file systems.
    2. Stop GPFS on the node. Verify that the GPFS daemon has terminated and that the kernel extensions have been unloaded (mmfsenv -u). If the command mmfsenv -u reports that it cannot unload the kernel extensions because they are "busy", then the install can proceed, but the node must be rebooted after the install. By "busy" this means that some process has a "current directory" in some GPFS filesystem directory or has an open file descriptor. The freeware program lsof can identify the process and the process can then be killed. Retry mmfsenv -u and if that succeeds then a reboot of the node can be avoided.
    3. Upgrade GPFS as follows(make sure to be in the same directory as the files):

      1. For Linux:

        For SLES or RedHat Enterprise Linux:

        rpm -Fvh gpfs*.rpm
        rpm -ivh gpfs.license.*.rpm (if you are updating from 4.2.1.2 or older version)
        rpm -ivh gpfs.compression.*.rpm

        For Debian and Ubuntu Linux:

        dpkg -i gpfs*.deb

        Recompile any GPFS portability layer modules you may have previously compiled. For more information, reference: Building the GPFS portability layer on Linux nodes




      2. For AIX:
        Use the 'inutoc .' command to create a .toc file which will be used by the installp command. The .toc file will be created in the current working directory.
        Once the .toc file is created, Upgrade GPFS using the installp command or via SMIT on the node. If you are in the same directory as the install packages and the .toc file, an example command might be:

        installp -agXYd . gpfs

Additional information

  • - Notices
  • - Package information

    The images listed below and contained in the Self Extracting Package (SE-Package) are maintenance packages for IBM Spectrum Scale. The images are a mix of normal RPM or DEB images that can be directly applied to your system.

    The packages can be used for new install or update from a prior level of IBM Spectrum Scale.

    After all RPMs or DEBs are installed, you have successfully updated your IBM Spectrum Scale product.

    Before installing IBM Spectrum Scale, it is necessary to verify that you have the correct levels of the prerequisite software installed on each node in the cluster. If the correct level of prerequisite software is not installed, see the appropriate installation manual before proceeding with your IBM Spectrum Scale installation.

    For the most up-to-date list of prerequisite software, see the IBM Spectrum Scale FAQ in the IBM® Knowledge Center .

    Update to Version:

    5.0.5.0

    Update from Version:

    4.2.0.0 - 5.0.4.4 (If upgrading node by node )
    3.5.0 - 5.0.4.4 (If you shutdown and upgrade the entire cluster)

    SE Package Content (SLES and RHEL Linux):

    • gpfs.msg.en_US-5.0.5-0.noarch.rpm
    • gpfs.base-5.0.5-0.*.rpm
    • gpfs.gpl-5.0.5-0.noarch.rpm
    • gpfs.docs-5.0.5-0.noarch.rpm
    • gpfs.compression-5.0.5-0.*.rpm
    • gpfs.gskit-8.0.55-12.*.rpm (expect s390x with gpfs.gskit-8.0.55-13.s390x.rpm)
    • gpfs.gui-5.0.5-0.noarch.rpm
    • gpfs.hdfs-protocol-2.7.3.*.rpm (x86_64, ppc64, and ppc64le only)
    • gpfs.hdfs-protocol-3.0.0.*.rpm (x86_64, ppc64, and ppc64le only)
    • gpfs.hdfs-protocol-3.1.*.rpm (x86_64, ppc64, and ppc64le only)
    • gpfs.java-5.0.5-0.*.rpm
    • gpfs.license.xxx-5.0.5-0.*.rpm (where xxx is the license type)
    • gpfs.callhome-5.0.5-0.xxx.noarch.rpm (where xxx is the OS type)
    • gpfs.callhome-ecc-client-5.0.5-0.noarch.rpm
    • gpfs.gss.pmcollector-5.0.5-0.xxx.*.rpm (where xxx is the OS type)
    • gpfs.gss.pmsensors-5.0.5-0.xxx.*.rpm (where xxx is the OS type)
    • gpfs.kafka-5.0.5-0.*.rpm (x86_64 only)
    • gpfs.librdkafka-5.0.5-0.*.rpm (x86_64 only)
    • gpfs.adv-5.0.5-0.*.rpm (IBM Spectrum Scale Advanced or Data Management Edition only)
    • gpfs.crypto-5.0.5-0.*.rpm (IBM Spectrum Scale Advanced or Data Management Edition only)
    • gpfs.tct.client-1.1.8*.rpm (IBM Spectrum Scale Advanced or Data Management Edition only, x86_64 and ppc64le only)
    • gpfs.tct.server-1.1.8*.rpm (IBM Spectrum Scale Advanced or Data Management Edition only, x86_64 and ppc64le only)

    SE Package Content (Ubunut Linux):

    • gpfs.msg.en_us_5.0.5-0_all.deb
    • gpfs.base_5.0.5-0_*.deb
    • gpfs.gpl_5.0.5-0_all.deb
    • gpfs.docs_5.0.5-0_all.deb
    • gpfs.compression_5.0.5-0_*.deb
    • gpfs.gskit_8.0.55-12_*.deb (expect s390x with gpfs.gskit-8.0.55-13_s390x.deb)
    • gpfs.gui_5.0.5-0_all.deb
    • gpfs.java_5.0.5-0_*.deb
    • gpfs.kafka_5.0.5-0_*.deb (x86_64 only)
    • gpfs.librdkafka_5.0.5-0_*.deb (x86_64 only)
    • gpfs.license.xxx_5.0.5-0_*.deb (where xxx is the license type)
    • gpfs.gss.pmcollector_5.0.5-0.xxx_*.deb (where xxx is the license type)
    • gpfs.gss.pmsensors_5.0.5-0.xxx_*.deb (where xxx is the license type)
    • gpfs.adv_5.0.5-0_*.deb (IBM Spectrum Scale Advanced or Data Management Edition only)
    • gpfs.tct.client-1.1.8*.deb (IBM Spectrum Scale Advanced or Data Management Edition only, x86_64 only)
  • - Summary of changes for IBM Spectrum Scale

    Changes to the IBM Spectrum Scale 5.0.5.0 include the following:

    • AFM and AFM DR-related changes
      
      
          Migration enhancements for AFM data migration. Set the afmReadDir
            Once and afmRefreshOnce parameters of AFM. 
          Support of fast create for AFM and AFM-DR. The parameter afmFastCreate 
            must be enabled for the fast create feature. 
      
      
      
      
    • Changes in IBM Spectrum Scale Big Data Analytics Integration Toolkit for HDFS Transparency (Toolkit for HDFS) 1.0.0.1
      Supports deployment on ESS.
      Supports remote mount filesystem only for CES HDFS protocol.
      Requires IBM Spectrum Scale 5.0.4.3 and HDFS Transparency 3.1.1-0.
      
      
    • File audit logging changes
      With fileset file audit logging, you can specify a list of filesets to 
      enable or skip from a file system. 
      
      
    • File system core improvements
      File encryption supports IBM® Security Key Lifecycle Manager (SKLM) 4.0
         File encryption supports SKLM 4.0 as a Remote Key Management (RKM) server. 
      
      File encryption supports Thales Vormetric DSM 6.3 and DSM 6.4
         File encryption supports Thales Vormetric DSM 6.3 and DSM 6.4 as a Remote Key Management servers.
      
      IBM Spectrum Scale supports Windows Server 2019
         
      The mmkeyserv command replaces expired key client certificates
         The mmkeyserv client update command replaces an expired or unexpired certificate 
         in a key client. You no longer need to follow the lengthy manual method for 
         replacing a key client certificate.
      
      Contiguous AIO/DIO write operations are combined before being committed to storage
         The dioSmallSeqWriteBatching attribute of the mmchconfig command holds small 
         Asynchronous Input/Output-Direct I/O write operations (up to 64 KiB) for a 
         few microseconds and combines any contiguous write operations that occur before 
         committing the write data to storage.
      
      The cp --preserve=xattr Linux command copies ACL attributes
         The cp --preserve=xattr Linux command is extended to copy the following 
           attributes when a file is copied:
      
          system.posix_acl_access -- The access ACL of the file
          system.posix_acl_default -- The default ACL of the file
          system.gpfs_nfs4_acl -- The GPFS internal NFS4 ACL attribute
      
      Performance improvements
          
          Performance is greatly improved for listing the files in a directory that 
             contains a large number of fileset junctions.
          Faster processing of quota checking (mmcheckquota) while traversing sparse 
             sections of a very large inode0 file.
          Performance is improved for mmap read workloads when multiple threads read the same file.
      
      Support all 12 Gb/s LSI RAID Controller Cards.
      New disk performance precheck tool.
      mmvdisk suspend node with deferred rebuild process for maintenance.
      Disk management trouble shooting improvements.
      Support Mellanox ConnectX-6 (Ethernet or InfiniBand).
      
      
      
      
    • IBM Spectrum Scale management API changes
      None
      
    • IBM Spectrum Scale GUI changes Created Files > Clustered Watch Folder page in the GUI to view the list of the clustered watch folders that are configured in the system. You can also view the details of each watch folder and the events that are raised against each record from the detailed view. To access the detailed view, select the watch folder for which you need the details and click View Details. In the Files > File Systems page, added the details such as whether the clustered watch is enabled at the file system level and the number of watched filesets under a file system. In the Files > Filesets page, added the details such as whether the clustered watch is enabled at the fileset level and the number of watched inodes.
    • Installation toolkit changes
      
          Support for packages signed with a GPG (GNU Privacy Guard) key
          Enhanced handling of host entries in the /etc/hosts file. 
          Support for both FQDN and short name.
          Support for online rolling upgrade 
      
    • NFS changes
      Client-specific statistics are supported.
          For the performance analysis of the CES NFS server, it is important to 
             understand the workload that is exerted by the NFS clients. This new 
             feature replaced dependency on customers to understand the client-side 
             workload. It provides the following client-specific statistics:
      
              client_io_ops - This statistics counting is enabled by default. 
                 This statistics counting provides information on all I/O-specific 
                 operations such as READ, WRITE of all supported NFS protocols 
                 (NFSv3, NFSv4.0) exerted by the NFS client (client IP address). 
                 This statistics helps to understand I/O workload exerted by a specific NFS client.
              client_all_ops - This statistics counting provides information on all 
                 operations of NFS protocols such as NFSv3, NLM, NFSv4.0. This statistics 
                 counting is disabled by default. You must enable it to extract the statistics. 
                 This statistics helps to understand all workload exerted by the NFS client.
      
      DNS related stats can be captured as a part of the authentication statistics collection.
      
      Various improvements in metadata caching module (MDCACHE), which includes the directory listing area.
    • IBM Spectrum Scale SMB changes
      
              Added the best practices for using SMB
      
              Currency: The SMB service has been upgraded.
      
              Recovery lock: The SMB clustering component now uses a global file 
                lock to maintain cluster integrity. The recovery lock is placed in 
                the cesroot as //smb/ctdb-recovery-lock and is 
                held by the ctdb services on one of the CES cluster nodes.
      
              File handles for Mac clients: Modern Mac OS clients have changed handling 
                FileID=0 or File_ids_off=yes in /etc/nsmb.conf. The SMB service now 
                returns file handles built upon the GPFS inode number, generation number, 
                and snapshot number to Mac clients instead of just 0. Thus the 
                “File_ids_off=yes” setting in /etc/nsmb.conf has to be removed.
      
              Error messages and trouble shooting procedures have been improved for SMB share modes.
      
      
      
      
    • System Health changes
      
      New events added
          New events have been added to the following sections: For more information, see Events.
      
      New measurement options for mmhealth command
          The following measurement options have been added to the mmhealth thresholds add command:
      
          For more information, see mmhealth command and Use case 5 in Threshold monitoring use cases.
      
      Changes in performance metrics behavior
      
    • Callhome
      None
      
    • Security-Enhanced Linux (SELinux) changes
      IBM Spectrum Scale now runs on supported Red Hat Enterprise Linux operating 
      systems with Security-Enhanced Linux (SELinux) enforcing mode and targeted policies.
      
    • New Commands
      
      
    • New subroutines
      
          gpfs_getacl_fd()
          gpfs_putacl_fd()
      
      
    • New Messages
      6027-1761, 6027-2413 and 6027-4210
      
    • Changed commands
      
      
          mmafmconfig
          mmafmctl
          mmaudit
          mmchconfig
          mmchfileset
          mmkeyserv
          mmlsquota
          mmnfs
          mmwatch
          spectrumscale
      
      
    • Features stabilized in Version 5.0.5
      
      FPO
      
      
    • Features deprecated in Version 5.0.5
      
      Category                 Deprecated functionality                Recommended Action          
      
      Security                 The use of TLS 1.0 and 1.1 for          Upgrade to TLS 1.2 or later  
                               authorization within and between 
                               the IBM Spectrum Scale clusters 
                               (Security mode)
      
      GUI/REST API             The use of TLS 1.0 and 1.1 for          Upgrade to TLS 1.2 or later 
                               authorization with the GUI/REST 
                               API server
      
      Cloud                    Storage Enabler for Containers (SEC)    Adopt the CSI driver. Note that we 
                                                                       plan to discontinue support for SEC 
                                                                       in the next release.
      
      Platforms                Encryption acceleration library         No functional impact: performance only 
                                                                       on Power7. If encryption performance 
                                                                       is critical, plan to migrate to newer 
                                                                       generations of Power systems. Note that 
                                                                       we plan to discontinue support for 
                                                                       CliC in the next release. 
      
      Platforms                Support for Power7                      Plan to migrate to newer generations 
                                                                       of Power systems.
      
      HDFS Transparency
      
    • Features discontinued in Version 5.0.5
      Category                 Discontinued functionality                Recommended Action
      
      HDFS Transparency        Support for IBM BigInsights for           IBM BigInsights for Apache Hadoop is 
                               Apache Hadoop                             no longer supported by IBM. 
                                                                         Consequently, IBM Spectrum Scale no 
                                                                         longer supports the use of BigInsights 
                                                                         as a Hadoop connection. 
      
      Platforms                Windows 7 and Windows Server 2008 R2      Upgrade to a supported version of 
                                                                         Windows.
      

Related Information

[{"Business Unit":{"code":"BU054","label":"Systems w\/TPS"},"Product":{"code":"STXKQY","label":"IBM Spectrum Scale"},"Component":"","ARM Category":[],"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"","Edition":"","Line of Business":{"code":"LOB26","label":"Storage"}}]

Document Information

Modified date:
22 May 2020

UID

isg400004997