HDFS Transparency package
This topic helps in the preparation to install HDFS Transparency package.
IBM Spectrum Scale HDFS Transparency (HDFS Protocol) offers a set of interfaces that allows applications to use HDFS client to access IBM Spectrum Scale through HDFS RPC requests.
All data transmission and metadata operations in HDFS are done through the RPC mechanism, and processed by the NameNode and the DataNode services within HDFS.
From IBM Spectrum® Scale 5.0.3, the IBM Spectrum Scale gpfs_rpms directory will no longer host a version of the HDFS Transparency. Multiple versions of HDFS Transparency will reside in the hdfs_rpms directory. Choose the HDFS Transparency version corresponding to the support matrix and copy it to location where the gpfs rpms resides.
IBM Spectrum Scale HDFS Transparency is independently installed from IBM Spectrum Scale and provided as an rpm package. HDFS Transparency supports both local and shared storage modes.
You can download the IBM Spectrum Scale HDFS Transparency from the HDFS Transparency download section.
The module name is gpfs.hdfs-protocol-3.<release>.0-(version).
Save this module in the IBM Spectrum Scale repository.
- Ensure that there is only one package of the transparency in the IBM Spectrum Scale repository. Rebuild the repository by executing the "createrepo . " command to update the repository metadata.
- Properly review and set OS tuning for all nodes in HDFS Transparency and Configure NTP to synchronize the clock in HDFS Transparency for all nodes.