Enabling GPFS IO on IBM Spectrum LSF Suite for Enterprise

Enabling GPFS IO allows IBM Spectrum LSF Suite for Enterprise to collect fine-grained statistics for accounting and monitoring. IBM Spectrum LSF Suite for Enterprise supports GPFS version 5 and higher.

The Workload Scale IO Accounting report is a job level scale IO statistics report. This report can be used for scenarios such as:
  • Accounting for GPFS IO usage distribution by time.
  • Charge back accounting.
  • To detect abnormal or malicious users or jobs.
  • To provide hints for system troubleshooting.
The Workload Scale IO line chart in the Workload Monitor report measures:
  • Total Read Size (MB)
  • Total Write Size (MB)
  • Read Bytes Per Second
  • Write Bytes Per Second
  • Read Operations Per Second
  • Write Operations Per Second

During IBM Spectrum LSF Suite for Enterprise installations the GPFSIO_MONITOR parameter can be specified in the lsf_inventory.yml file. It runs on one host in the cluster to ingest Spectrum Scale data. Specify which host is to run the lsf-beat that collects the GPFS data.

Note: If the GPFS_DEVICE name is not the default "gpfs1", the correct name should be configured manually in the join.config.json file located in /opt/ibm/elastic/gpfsio/config/gpfs/ after installation and lsf-beat must be restarted.

Post-installation, GPFS IO can be installed and enabled with the mmchqos command :

mmchqos $device --enable --fine-stats 120 --pid-stats yes

Here, "$device" refers to the GPFS device name. Also ensure that lsf-beat has been installed.