The IBM Storage Scale HDFS transparency log

In IBM Storage Scale HDFS transparency, all logs are recorded using log4j. The log4j.properties file is under /var/mmfs/hadoop/etc/hadoop for HDFS Transparency version 3.x and under /usr/lpp/mmfs/hadoop/etc/hadoop for HDFS Transparency version 2.7.x.

By default, the logs are written under:

/var/log/hadoop/root for HDFS Transparency version 2.6.x and later for HDP distribution
/var/log/transparency for HDFS Transparency version 3.x for Open Source Apache distribution
/usr/lpp/mmfs/hadoop/logs for HDFS Transparency version 2.7.x for Open Source Apache distribution

The following entries can be added into the log4j.properties file to turn on the debugging information:

log4j.logger.org.apache.hadoop.yarn=DEBUG
log4j.logger.org.apache.hadoop.hdfs=DEBUG
log4j.logger.org.apache.hadoop.gpfs=DEBUG
log4j.logger.org.apache.hadoop.security=DEBUG