Support matrix
This section describes the Hadoop distribution support matrix.
Cloudera Hortonworks Data Platform (HDP) release is end of support. For more information, see Cloudera lifecycle policy.
| IBM Spectrum Scale™ Ambari management pack (Mpack) | HDFS Transparency | Hadoop distribution | Ambari version | RHEL x86_64 |
RHEL ppc64le |
SLES x86 |
|---|---|---|---|---|---|---|
| Mpack 2.7.0.10 | HDFS Transparency 3.1.0-1 to latest 3.1.0-x stream | HDP 3.1.5 HDP 3.1.4 |
Ambari 2.7.5.17-6 | 7.9 | NA | NA |
| Mpack 2.7.0.9 | HDFS Transparency 3.1.0-1 to latest 3.1.0-x stream | HDP 3.1.5 HDP 3.1.4 |
Ambari 2.7.5.0 Ambari 2.7.4.0 |
7.6/7.7/7.8/7.9 | 7.6/7.7 | SLES 12 SP3/SLES 12 SP41 |
| Mpack 2.7.0.8 | HDFS Transparency 3.1.0-1 to latest 3.1.0-x stream | HDP 3.1.5 HDP 3.1.4 |
Ambari 2.7.5.0 Ambari 2.7.4.0 |
7.2/7.3/7.4/7.5/7.6/7.7/7.8/7.9 | 7.4/7.5/7.6/7.7 | SLES 12 SP3/SLES 12 SP41 |
| Mpack 2.7.0.7 Superseded by Mpack 2.7.0.8 |
HDFS Transparency 3.1.0-1 to latest 3.1.0-x stream | HDP 3.1.5 HDP 3.1.4 |
Ambari 2.7.5.0 Ambari 2.7.4.0 |
7.2/7.3/7.4/7.5/7.6/7.7 | 7.4/7.5/7.6/7.7 | SLES 12 SP3/SLES 12 SP41 |
| Mpack 2.7.0.6 Superseded by Mpack 2.7.0.8 |
HDFS Transparency 3.1.0-1 to latest 3.1.0-x stream | HDP 3.1.5 | Ambari 2.7.5.0 | 7.2/7.3/7.4/7.5/7.6/7.7 | 7.4/7.5/7.6/7.7 | SLES 12 SP3/SLES 12 SP41 |
| Mpack 2.7.0.5 Superseded by Mpack 2.7.0.8 |
HDFS Transparency 3.1.0-1 to latest 3.1.0-x stream | HDP 3.1.4 | Ambari 2.7.4.0 | 7.2/7.3/7.4/7.5/7.6 | 7.4/7.5/7.6 | SLES 12 SP31 |
| Mpack 2.7.0.4 Superseded by Mpack 2.7.0.8 |
HDFS Transparency 3.1.0-1 to latest 3.1.0-x stream | HDP 3.1.4 | Ambari 2.7.4.0 | 7.2/7.3/7.4/7.5/7.6 | 7.4/7.5/7.6 | SLES 12 SP31 |
| Mpack 2.7.0.3 | HDFS Transparency 3.1.0-1 to latest 3.1.0-x stream | HDP 3.1.0 | Ambari 2.7.3.0 | 7.2/7.3/7.4/7.5/7.6 | 7.4/7.5/7.6 | SLES 12 SP31 |
| Mpack 2.7.0.2 | HDFS Transparency 3.1.0-0 | HDP 3.1.0 | Ambari 2.7.3.0 | 7.2/7.3/7.4/7.5/7.6 | 7.4/7.5/7.6 | SLES 12 SP31 |
| Mpack 2.7.0.1 | HDFS Transparency 3.1.0-0 | HDP 3.0.1 | Ambari 2.7.0.1 | 7.2/7.3/7.4/7.5 | 7.4/7.5 | |
| Mpack 2.7.0.0 | HDFS Transparency 3.0.0-0 | HDP 3.0.0 | Ambari 2.7.0.0 | 7.2/7.3/7.4/7.5 | 7.4/7.5 |
1 For SLES12 environment, Mpack 2.7.0.2 only supports new HDP installations.
- HDP and Mpack requires Python 2.7.
- HDP Java™ Development Kits (JDKs): OpenJDK on ppc64le and Oracle JDK on x86_64.
- IBM Storage Scale file
system release supported: 4.1.1.3+, 4.2.2.3+, 4.2.3.1+,5.0.X+ on pc64le and x86_64.
RH 7.5 is supported from V4.2.3.9 and V5.0.1.1.
RH 7.6 is supported from V4.2.3.13 and V5.0.2.2.
- IBM Storage Scale Management GUI function requires RHEL 7.2+ at IBM Storage Scale version 4.2.X+.
- IBM Storage Scale snap data for Hadoop function requires RHEL 7.2+ at IBM Storage Scale version 4.2.2.X+.
- Preserving Kerberos token delegation during NameNode failover with HDP is supported when Mpack 2.7.0.1 and HDFS Transparency 3.1.0-0 are applied together.
- HDP 3.1 with Mpack 2.7.0.3 and HDFS Transparency 2.7.0.3 supports ViewFS in Ambari. For more information, see Configure ViewFs on HDFS clusters without HA and Configuring ViewFs on HDFS cluster with HA.
- HDP supports HDFS Transparency 3.1.0-x stream and earlier.
- CES HDFS does not support HDP.
- With Mpack 2.7.0.7, you can upgrade HDP 3.1.x HA without unintegrating HDFS Transparency. For more information, see Upgrading HDP overview.
- From Mack 2.7.0.8, to change the IBM
Storage® Scale tunables, run the corresponding mm* command for that specific
tunable on the command line. Therefore, the tunables seen in the IBM Spectrum Scale service panel and the IBM Spectrum Scale cluster/file system will not be the same. Refer to the IBM Spectrum Scale cluster/file system information from
command line for current values of the tunables for the node/cluster.
When you are deploying Mpack, upgrading Mpack, reintegrating HDFS Transparency, and restarting the IBM Spectrum Scale service, if the gpfs.storage.type parameter is set to shared, the IBM Spectrum Scale configurations will not be overwritten.