Upgrading CDP
This section lists the steps to upgrade CDP Private Cloud Base cluster integrated with IBM Storage Scale from existing CDP Private Cloud Base version to a newer CDP Private Cloud Base version.
Note: To ensure that the correct software stack compatibility versions are adhered to, see the CDP Private Cloud Base support matrix.
Offline upgrade procedure
- Stop all the CDP cluster services from Cloudera Manager. This will stop CDP Hadoop services and CES HDFS Transparency services.
- Upgrade the IBM Storage Scale software.
You can upgrade either manually or by using the installation toolkit.
- For installation toolkit upgrade process, see Performing online upgrade by using the installation
toolkit.Note: The installation toolkit automatically updates only the HDFS package when the HDFS protocol is enabled. To check if HDFS protocol is enabled, run the ./spectrumscale node list command.
- For manual upgrade process, see the following sections:
- Upgrading IBM Storage Scale non-protocol Linux® nodes
- Upgrading IBM Storage Scale protocol nodes.
- Upgrade the HDFS Transparency package on each node by running the following
command:
rpm -Uvh gpfs.hdfs-protocol-3.1.1-<version>.<os>.rpm
Note: The IBM Storage Scale extract package will contain the new IBM Storage Scale CSD package. If you are using the installation toolkit, it will be on the installer node.
- For installation toolkit upgrade process, see Performing online upgrade by using the installation
toolkit.
- Upgrade the IBM Storage Scale CSD by running the
following steps:
- Log in to the Cloudera Manager node.
- Copy the latest IBM Storage Scale CSD package
from the IBM Storage Scale Installer node to a local
directory. For example, /root/latest_csd/.
# scp <Spectrum Scale Installer node>:/usr/lpp/mmfs/<Spectrum Scale version>/hdfs_rpms/rhel/hdfs_3.1.1.x/gpfs.hdfs.cloudera.cdp.csd-<Latest CSD version>.noarch.rpm /root/latest_csd/
For example:
# scp <Spectrum Scale Installer node>:/usr/lpp/mmfs/5.1.2.0/hdfs_rpms/rhel/hdfs_3.1.1.x/gpfs.hdfs.cloudera.cdp.csd-1.2.0-0.noarch.rpm /root/latest_csd/
- Upgrade the IBM Storage Scale CSD package by
running the following command:
# cd /root/latest_csd # rpm -Uvh gpfs.hdfs.cloudera.cdp.csd-<Latest CSD version>.noarch.rpm For example:# rpm -Uvh gpfs.hdfs.cloudera.cdp.csd-1.2.0-0.noarch.rpm
- Restart the Cloudera Manager. The restart picks up the new IBM Storage Scale CSD for Cloudera Manager.
- Upgrade the CDP stack by following the steps mentioned in Upgrading CDP Private Cloud Base to a higher version.
- From Cloudera Manager, start all the services. This will start the CDP Hadoop services and the CES HDFS Transparency NameNodes and DataNodes.
- Verify the upgrade. To verify, see Verifying the CDP upgrade.