Hadoop IBM Storage Scale architecture

IBM Storage Scale allows Hadoop applications to access centralized storage or local storage data. All Hadoop nodes can access the storage as a GPFS™ client. You can share a cluster between Hadoop and any other application.

IBM Storage Scale has the following supported storage modes that Hadoop can access:

  • Centralized storage mode:
    • IBM Storage Scale System
    • IBM® Erasure Code Edition
    • Shared Storage (SAN-based storage)
  • Local storage mode:
    • File Placement Optimizer