HDFS Transparency Tuning

Tuning for IBM Storage Scale FPO
If you deploy the Hadoop cluster through Ambari (for both HortonWorks and IBM® BigInsights® IOP), Ambari will do some default tuning according to your cluster and you do not need to do special tuning for HDFS Transparency.
Tuning for IBM Storage Scale over shared storage or IBM Storage Scale System
If you deploy the Hadoop cluster through Ambari (for both HortonWorks and IBM BigInsights IOP), Ambari will do some default tuning according to your cluster.
Special tuning for IBM Storage Scale
For better performance, if all the Hadoop nodes are in IBM Storage Scale cluster (as IBM Storage Scale client or NSD server or FPO nodes), you should enable Hadoop short circuit read from HDFS Transparency 2.7.3 as this will bring data read performance. From HDFS Transparency 2.7.3-1, short circuit write is enabled to improve the data write performance when short circuit read is enabled.
Buffered logging and filtering
Learn to configure the Apache Log4j utility's buffering and filtering features, which have demonstrated reduction of load on the logging subsystem, indirectly increasing HDFS Transparency throughput.

Parent topic: Performance guide