License planning

HDFS Transparency does not require additional license. If you have IBM Storage Scale license, you can get the HDFS Transparency package from the IBM Storage Scale package or see the HDFS Transparency download section.

As for IBM Storage Scale license, any IBM Storage Scale license works with HDFS Transparency. However, you should take IBM Storage Scale Standard Edition or IBM Storage Scale Advanced Edition or Data Management Edition so that you could leverage some advanced enterprise features (such as IBM Storage Scale storage pool, fileset, encryption or AFM) to power your Hadoop data platform.

First go through the Hadoop IBM Storage Scale architecture section, select the mode that you are planning to use and then refer the license requirements in the following table:

Table 1. IBM Storage Scale License requirement
Storage category Deployment mode License requirement
IBM Storage Scale FPO Illustrated in Figure 1
  • 3+ IBM Storage Scale server license for manager/quorum (3 quorum tolerates 1 quorum node failure. If you want higher quorum node failure tolerance, you need to configure more quorum node/licenses, maximally up to 8 quorum nodes in one cluster).
  • All other nodes take the IBM Storage Scale FPO license.
Note: If you purchase IBM Storage Scale capacity license, you do not need to purchase additional licenses mentioned above.
IBM Storage Scale + SAN storage Illustrated in Figure 3
  • All NSD servers must be with IBM Storage Scale server license.
  • At least 2 NSD servers are required for HDFS Transparency (1 NameNode and 1 DataNode); it is recommended to take 4+ NSD servers for HDFS Transparency (1 active NameNode, 1 standby NameNode, 2 DataNodes).
Note: If you purchase IBM Storage Scale capacity license, you do not need to purchase additional licenses mentioned above.
Illustrated in Figure 2

(configure one IBM Storage Scale cluster)
  • 2+ IBM Storage Scale server license for quorum/NSD servers with tiebreak disks for quorum. If you want to tolerate more quorum node failure, configure more IBM Storage Scale NSD servers/quorum nodes.
    • All HDFS Transparency nodes should take IBM Storage Scale server license under this configuration.
Note: If you purchase IBM Storage Scale capacity license, you do not need to purchase additional licenses mentioned above.
Illustrated in Figure 1

(configure IBM Storage Scale multi-cluster)
  • For home IBM Storage Scale cluster (NSD server cluster), 2+ NSD servers (IBM Storage Scale server license) configured with tiebreak disks for quorum. If you want to tolerate more quorum node failure, configure more IBM Storage Scale NSD servers/quorum nodes.
  • For local IBM Storage Scale cluster (all as IBM Storage Scale clients), 3+ IBM Storage Scale server license for quorum/manager (configure more IBM Storage Scale server license node to tolerate more quorum node failure); All HDFS Transparency nodes take IBM Storage Scale server license. other nodes could take IBM Storage Scale client license.
Note: If you purchase IBM Storage Scale capacity license, you do not need to purchase additional licenses mentioned above.
Illustrated in Figure 1

(configure IBM Storage Scale multi-cluster)
  • For home IBM Storage Scale cluster (NSD server cluster), 2+ NSD servers (IBM Storage Scale server license) configured with tiebreak disks for quorum. If you want to tolerate more quorum node failure, configure more IBM Storage Scale NSD servers/quorum nodes.
  • For local IBM Storage Scale cluster (all as IBM Storage Scale clients), 3+ IBM Storage Scale server license for quorum/manager (configure more IBM Storage Scale server license node to tolerate more quorum node failure) is required. All other HDFS Transparency nodes need IBM Storage Scale server license.
Note: If you purchase IBM Storage Scale capacity license, you do not need to purchase additional licenses mentioned above.
IBM Storage Scale System Illustrated in Figure 2

(configure one IBM Storage Scale cluster)
  • If you take the IBM Storage Scale System nodes as the quorum nodes, then you do not need to purchase the new IBM Storage Scale licenses.
    Note: Purchasing IBM Storage Scale System will give you the license rights to use the nodes as quorum.
  • All other nodes take IBM Storage Scale server license.
Note: If you purchase IBM Storage Scale System with IBM Storage Scale capacity license, you do not need to purchase additional licenses mentioned above.
Illustrated in Figure 1

(configure IBM Storage Scale multi-cluster)
  • Create IBM Storage Scale System nodes as home cluster (you do not need to purchase new IBM Storage Scale license after you purchase IBM Storage Scale System).
  • For local IBM Storage Scale cluster (all as IBM Storage Scale clients), 3+ IBM Storage Scale server license for quorum/manager (configure more IBM Storage Scale server license node to tolerate more quorum node failure); all other take IBM Storage Scale server license.
Note: If you purchase IBM Storage Scale System with IBM Storage Scale capacity license, you do not need to purchase additional licenses mentioned above.
Illustrated in Figure 1

(configure IBM Storage Scale multi-cluster)
  • Create IBM Storage Scale System nodes as home cluster (you do not need to purchase new IBM Storage Scale license after you purchase IBM Storage Scale System).
  • For local IBM Storage Scale cluster (all as IBM Storage Scale clients), 3+ IBM Storage Scale server license for quorum/manager (configure more IBM Storage Scale server license node to tolerate more quorum node failure); all other HDFS Transparency nodes take IBM Storage Scale server license.
Note: If you purchase IBM Storage Scale System with IBM Storage Scale capacity license, you do not need to purchase additional licenses mentioned above.
Note: If you plan to configure IBM Storage Scale protocol, you need to configure IBM Storage Scale services over nodes with IBM Storage Scale server license but no NSD disks in the file system. If you purchase IBM Storage Scale capacity license, you do not need to purchase additional licenses for IBM Storage Scale Protocol nodes.