Upgrading HDFS Transparency

You must plan a cluster maintenance window, and prepare for the cluster downtime while upgrading the HDFS Transparency.

You can update HDFS Transparency as follows:

Using Ambari GUI under IBM Spectrum® Scale service, Upgrade Transparency action
Using yum update on the nodes
Using rpm update on the nodes

The IBM Spectrum Scale update package and the HDFS Transparency is upgraded separately.

This section describes how to update HDFS Transparency through Ambari.

Save the new IBM Spectrum Scale HDFS Transparency package into the existing IBM Spectrum Scale yum repository. Ensure that this IBM Spectrum Scale GPFS yum repository is the same repository as the one specified in the GPFS_REPO_URL. Click Ambari IBM Spectrum Scale > Configs > Advanced gpfs-ambari-server-env > GPFS_REPO_URL.
If the yum repository is different, see GPFS yum repo directory to update the yum repository.

Remove the old version of the IBM Spectrum Scale HDFS Transparency or save it at another location.
Note:
- Ensure that the IBM Spectrum Scale rpms in the IBM Spectrum Scale service configuration panel under Advanced gpfs-ambari-server-env, GPFS_REPO_URL, are the same as the IBM Spectrum Scale version currently installed on the system.
- Do not change the GPFS_REPO_URL to point to a new URL during the upgrade phase.
- Ensure that only one HDFS Transparency version is in the GPFS_REPO_URL.
- Update only the HDFS Transparency version in the GPFS_REPO_URL if needed and run "createrepo . " to update the repolist.

Go to the IBM Spectrum Scale yum directory, and rebuild the yum database by running the createrepo command.

$ cd /var/www/html/repos/GPFS/<Scale_version>/gpfs_rpms
$ createrepo .
Spawning worker 0 with 2 pkgs
Spawning worker 1 with 2 pkgs
Spawning worker 2 with 2 pkgs
Spawning worker 3 with 2 pkgs
Workers Finished
Saving Primary metadata
Saving file lists metadata
Saving other metadata
Generating sqlite DBs
Sqlite DBs complete

From the dashboard, select Actions > Stop All¹ to stop all the services.
¹For FPO cluster, do not run STOP ALL from the Ambari GUI. Refer to the Limitations > General section on how to properly stop IBM Spectrum Scale.

Note: To upgrade the HDFS Transparency, the IBM Spectrum Scale file system does not need to be stopped. If you do not want to stop the IBM Spectrum Scale file system, do not select Actions > Stop All. Instead, stop all the services individually by going into each service panel, and clicking Actions > Stop for all, except the IBM Spectrum Scale service.
From the dashboard, click Spectrum Scale > Actions > Upgrade Transparency.
Check to see if the correct version of the HDFS Transparency is installed on all the GPFS nodes.
```
$ rpm -qa | grep hdfs-protocol
gpfs.hdfs-protocol-3.0.0-0.x86_64
```
If the HDFS Transparency version is not correct on a specific node, then manually install the correct version onto that node.

To manually install the HDFS Transparency on a specific node:
1. Remove the existing HDFS Transparency package by running the following command:
```
$ yum erase gpfs.hdfs-protocol<Old version>
$ yum clean all
```
2. yum install the new package.
```
$ yum install gpfs.hdfs-protocol-3.0.0.0.<OS>.rpm
```
On the dashboard, click Actions > Start All.
Note: If you are performing a BI/HDP upgrade or migrate procedure, do not start any services.

Check that the HDFS Transparency connector NameNode and DataNode are functioning.

$ /usr/lpp/mmfs/hadoop/sbin/mmhadoopctl connector getstate
c902f05x01.gpfs.net: namenode running as process 18150.
c902f05x01.gpfs.net: datanode running as process 22958.
c902f05x02.gpfs.net: datanode running as process 26416.
c902f05x03.gpfs.net: datanode running as process 17275.
c902f05x04.gpfs.net: datanode running as process 15560