Hadoop distribution support

Cloudera distributions and Open Source Apache Hadoop are the officially supported Hadoop distributions.

For more information, contact scale@us.ibm.com.

OS and Arch support

HDFS Transparency supports a subset of the supported operating systems and the architecture platform that IBM Storage Scale supports.

IBM Storage Scale aligns with the OS vendor life cycle support statement. For RHEL, see Red Hat® Enterprise Linux® Life Cycle.

Java support

HDFS Transparency requires Java™ OpenJDK 8 or OpenJDK 11.

OpenJDK 11 is supported from HDFS Transparency 3.1.1-8.

CDP Private Cloud Base support

Start of change
Table 1. CDP Private Cloud Base support
CDP Private Cloud Base version HDFS Transparency version
See Support matrix 3.1.1-X stream, 3.1.1-2 and later
End of change

Open Source Apache Hadoop support

  • Open Source Apache Hadoop support is based on Cloudera's Hadoop supported versions. For more information, see CDP Private Cloud Base support matrix and HDP support matrix.
  • IBM Storage Scale 5.1.3.2 technical preview release, the CES HDFS Transparency 3.2.2 is supported for a limited-time usage only on non-production clusters with Open Source Apache Hadoop 3.2.2 on RH 7.9 on x86_64.
  • From IBM Storage Scale 5.1.4.0, CES HDFS Transparency 3.2.2-0 is supported for Open Source Apache Hadoop 3.2.2 on RH 7.9 on x86_64.
  • From IBM Storage Scale 5.1.1.2, CES HDFS Transparency 3.3.x-x is supported for Open Source Apache Hadoop 3.3 on RH 7.9 on x86_64.

BigInsights IOP support

Support for IBM® BigInsights® is discontinued.

HDP support

Support for Cloudera HDP is discontinued.

Table 2. HDP support
HDP version HDFS Transparency version
HDP 3.1 3.1.0-X stream