Supported distributed files systems for MapReduce or YARN integration

This version of IBM® Spectrum Symphony supports the following distributed file systems for MapReduce and YARN.

The MapReduce framework and YARN integration is supported on IBM Spectrum Symphony Advanced Edition on Linux. You can run MapReduce jobs in an IBM Spectrum Symphony Developer Edition environment, and you can submit MapReduce jobs from IBM Spectrum Symphony Developer Edition to IBM Spectrum Symphony Advanced Edition.

Supported distributed file systems for MapReduce integration

IBM Spectrum Symphony supports the following distributed file systems for integrating MapReduce.

Table 1. Supported distributed files systems for MapReduce
Application Version Notes
IBM Spectrum Scale-FPO
  • 4.1.1
  • 4.2.1
  • 4.2.2
 None
Apache Hadoop Distributed File System (HDFS) 2.7.2 Open-source Hadoop distribution with both MRv1 and MRv2 applications is supported in standalone IBM Spectrum Symphony environment.

Supported distributed file systems for YARN integration

IBM Spectrum Symphony supports the following distributed file systems for integrated YARN jobs.

Table 2. Supported distributed files systems for YARN
File system Version
Apache Hadoop Distributed File System (HDFS) 2.7.2