CES HDFS

Starting from HDFS Transparency 3.1.1, HDFS Transparency is integrated with CES protocol and IBM Spectrum® Scale installation toolkit.

Overview
Starting from HDFS Transparency 3.1.1 and IBM Storage Scale 5.0.4.2, HDFS Transparency is integrated with the IBM Storage Scale installation toolkit and the Cluster Export Services (CES) protocol.
Planning
Support matrix
The support matrix for HDFS Transparency and the IBM Storage Scale Big Data Analytics Integration Toolkit for HDFS Transparency (Toolkit for HDFS) is bundled together to work for the supported IBM Storage Scale release.
Setup
Set up the basic IBM Storage Scale installation prerequisites before installing CES HDFS.
Installation
This section will describe the steps to install the HDFS Transparency nodes (NameNode and DataNodes) as GPFS client nodes to be added to the centralized storage system to create a single GPFS cluster. All other Hadoop nodes (master and clients) are to be set up outside of the GPFS cluster.
Upgrading CES HDFS Transparency
This section describes the process to upgrade CES HDFS Transparency.
Configuration
Administration
Advanced features

Parent topic: IBM Storage Scale support for Hadoop