Monitoring

This topic describes how to monitor HDFS Transparency in a Cloudera managed environment.

The IBM Storage Scale service subscribes to the standard Cloudera monitoring infrastructure. For details on Cloudera monitoring, see Accessing the Cloudera Manager Admin Console.

The time series data from HDFS Transparency on the Cloudera Manager GUI may be leveraged to monitor usage, performance, and other aspects. To view time series data, click Cloudera Manager home page > Charts > Chart Builder. In the Chart Builder query box, type the following to list all the graphs for HDFS Transparency NameNode.

select * where roleType=TRANSPARENCY_NAMENODE

To view all the attributes in individual graphs, click All Separate under Facets.

The query can be written for DataNode by replacing the roleType to TRANSPARENCY_DATANODE.

For more details on Cloudera TSQuery format and syntax, see tsquery Language.

You might query for individual parameters as well. For example, to find out the Active and Standby NameNodes, run the following query:

select spectrumscale_hdfs_ha_state where roleType=TRANSPARENCY_NAMENODE

In the resulting graph, Value of 2 indicates Standby and Value 3 indicates Active State.

Similarly, run the following tsquery to see the status of the filesystem·

select spectrumscale_hdfs_state