Support matrix
The support matrix for HDFS Transparency and the IBM Spectrum® Scale Big Data Analytics Integration Toolkit for HDFS Transparency (Toolkit for HDFS) is bundled together to work for the supported IBM Storage Scale release.
| IBM Storage Scale version | HDFS Transparency version | ||
|---|---|---|---|
| 3.1.1-x stream | 3.2.2-x stream | 3.3.0-x stream | |
| 5.1.8.1 | 3.1.1-14 | 3.2.2-5 | 3.3.0-2 |
| 5.1.7.1 - 5.1.8.0 | 3.1.1-13 | 3.2.2-5 | 3.3.0-2 |
| 5.1.7 | 3.1.1-12 | 3.2.2-4 | 3.3.0-2 |
| 5.1.6.1 | 3.1.1-12 | 3.2.2-3 | 3.3.0-2 |
| 5.1.6 | 3.1.1-11 | 3.2.2-3 | 3.3.0-2 |
| 5.1.5.1 | 3.1.1-10 | 3.2.2-2 | 3.3.0-2 |
| 5.1.5 | 3.1.1-10 | 3.2.2-1 | 3.3.0-2 |
| 5.1.4.1 | 3.1.1-10 | 3.2.2-1 | 3.3.0-2 |
| 5.1.4 | 3.1.1-9 | 3.2.2-1 | 3.3.0-1 |
| 5.1.3.2 | 3.1.1-8 | 3.2.2-0 | 3.3.0-1 |
| 5.1.3 - 5.1.3.1 | 3.1.1-8 | - | 3.3.0-1 |
| 5.1.2.9 | 3.1.1-12 | - | 3.3.0-2 |
| 5.1.2.6 - 5.1.2.8 | 3.1.1-10 | - | 3.3.0-2 |
| 5.1.2.2 - 5.1.2.5 | 3.1.1-8 | - | 3.3.0-1 |
| 5.1.2.1 | 3.1.1-7 | - | 3.3.0-0 |
| 5.1.2 | 3.1.1-6 | - | 3.3.0-0 |
| 5.1.1.2 - 5.1.1.4 | 3.1.1-5 | - | 3.3.0-0 |
| 5.1.1.1 | 3.1.1-5 | - | - |
| 5.1.1.0 | 3.1.1-4 | - | - |
| 5.1.0.1 - 5.1.0.3 | 3.1.1-3 | - | - |
Open Source Apache Hadoop support is certified on HDFS, Yarn, and MapReduce components with the
following configurations:
| Open Source Apache Hadoop version | HDFS Transparency version | OS | Platform |
|---|---|---|---|
| 3.1.3 | 3.1.1-x | RHEL 7.9 and later | x86_64 ppc64le |
| 3.2.2 | 3.2.2-x | RHEL 7.9 | x86_64 |
| 3.3.0 | 3.3.0-x | RHEL 7.9 | x86_64 |
For information about CDP Private Cloud Base support, see CDP Private cloud base support matrix.
Note:
- CES HDFS is not supported on Cloudera HDP distribution. For more information, see Cloudera HDP 3.X.
- Unlike previous versions of HDFS Transparency, HDFS Transparency 3.1.1-x, 3.2.2-x, and 3.3.0-x are tightly coupled with IBM Storage Scale. You need to upgrade the IBM Storage Scale package to get the correct supported versions for CES HDFS.
- Support for CES HDFS started from IBM Storage Scale 5.0.4.2 with HDFS Transparency 3.1.1-0 and Toolkit for HDFS 1.0.0.0.
- Support for CDP Private Cloud Base with CES HDFS started from IBM Storage Scale 5.1.0 with HDFS Transparency 3.1.1-2 package with bda_integration toolkit version 1.0.2.0.
- If the OS is not supported for a specific IBM Storage Scale release, then it is also not supported for HDFS Transparency. For more information, see OS and Arch support.