HDFS Transparency support matrix
The support matrix for HDFS Transparency and the IBM Storage Scale Big Data Analytics Integration Toolkit for HDFS Transparency (Toolkit for HDFS) is bundled together to work for the supported IBM Storage Scale release.
| IBM Storage Scale version | HDFS Transparency version | ||
|---|---|---|---|
| 3.1.1-x stream | 3.2.2-x stream | 3.3.0-x stream | |
| 5.2.0.0 | 3.1.1-17 | 3.2.2-8 | N/A |
| 5.1.9.2+ | 3.1.1-17 | 3.2.2-7 | N/A |
| 5.1.9.1 | 3.1.1-16 | 3.2.2-7 | N/A |
| 5.1.9.0 | 3.1.1-15 | 3.2.2-6 | N/A |
| 5.1.8.1 | 3.1.1-14 | 3.2.2-5 | 3.3.0-2 |
| 5.1.7.1 - 5.1.8.0 | 3.1.1-13 | 3.2.2-5 | 3.3.0-2 |
| 5.1.7 | 3.1.1-12 | 3.2.2-4 | 3.3.0-2 |
| 5.1.6.1 | 3.1.1-12 | 3.2.2-3 | 3.3.0-2 |
| 5.1.6 | 3.1.1-11 | 3.2.2-3 | 3.3.0-2 |
| 5.1.5.1 | 3.1.1-10 | 3.2.2-2 | 3.3.0-2 |
| 5.1.5 | 3.1.1-10 | 3.2.2-1 | 3.3.0-2 |
| 5.1.4.1 | 3.1.1-10 | 3.2.2-1 | 3.3.0-2 |
| 5.1.4 | 3.1.1-9 | 3.2.2-1 | 3.3.0-1 |
| 5.1.3.2 | 3.1.1-8 | 3.2.2-0 | 3.3.0-1 |
| 5.1.3 - 5.1.3.1 | 3.1.1-8 | - | 3.3.0-1 |
| 5.1.2.9 | 3.1.1-12 | - | 3.3.0-2 |
| 5.1.2.6 - 5.1.2.8 | 3.1.1-10 | - | 3.3.0-2 |
| 5.1.2.2 - 5.1.2.5 | 3.1.1-8 | - | 3.3.0-1 |
| 5.1.2.1 | 3.1.1-7 | - | 3.3.0-0 |
| 5.1.2 | 3.1.1-6 | - | 3.3.0-0 |
Open-source Apache Hadoop support is certified on HDFS, Yarn, and MapReduce components with the
following configurations:
| Open-source Apache Hadoop version | HDFS Transparency version | OS | Platform |
|---|---|---|---|
| 3.1.3 | 3.1.1-0 - 3.1.1-14 |
RHEL 7.9
RHEL 8.x RHEL 9.x |
x86_64 ppc64le |
| 3.2.2 | 3.2.2-x |
RHEL 7.9
RHEL 8.x RHEL 9.x |
x86_64 |
| 3.3.0 | 3.3.0-x | RHEL 7.9 | x86_64 |
|
Note: IBM Storage Scale 5.2.0.0 does not support RHEL 7.9.
|
|||
For more information about CDP Private Cloud Base support, see CDP Private cloud base support matrix.
Note:
- CES HDFS is not supported on Cloudera HDP distribution.
- Unlike previous versions of HDFS Transparency, HDFS Transparency 3.1.1-x, 3.2.2-x, and 3.3.0-x are tightly coupled with IBM Storage Scale. You need to upgrade the IBM Storage Scale package to get the correct supported versions for CES HDFS.
- Support for CES HDFS started from IBM Storage Scale 5.0.4.2 with HDFS Transparency 3.1.1-0 and Toolkit for HDFS 1.0.0.0.
- Support for CDP Private Cloud Base with CES HDFS started from IBM Storage Scale 5.1.0 with HDFS Transparency 3.1.1-2 package with bda_integration toolkit version 1.0.2.0.
- If the OS is not supported for a specific IBM Storage Scale release, then it is also not supported for HDFS Transparency. For more information, see OS and Arch support.
- Unlike previous versions of HDFS Transparency 3.1.1-x, HDFS Transparency 3.1.1-15+ is delivered without dependent JAR files. For more information about the installation process, see Installation prerequisites.
- Unlike previous versions of HDFS Transparency 3.2.2-x, HDFS Transparency 3.2.2-6+ is delivered without dependent JAR files. For more information about the installation process, see Installation prerequisites.