Data collection

The following new features affect IBM Spectrum LSF data collection.

IBM Spectrum Scale disk I/O accounting using Elasticsearch

LSF now uses IBM Spectrum LSF Explorer (LSF Explorer) to collect IBM Spectrum Scale disk I/O accounting data which, when combined with LSF job information, allows LSF to provide job-level IBM Spectrum Scale I/O statistics. To use this feature, LSF Explorer must be deployed in your LSF cluster, and LSF must be using IBM Spectrum Scale as the file system. To enable IBM Spectrum Scale disk I/O accounting, configure LSF_QUERY_ES_FUNCTIONS="gpfsio" (or LSF_QUERY_ES_FUNCTIONS="all") and LSF_QUERY_ES_SERVERS="ip:port" in the lsf.conf file.

Use the following commands to display IBM Spectrum Scale disk I/O accounting information:

  • bacct -l displays the total number of read/write bytes of all storage pools on IBM Spectrum Scale.
  • bjobs -l displays the accumulated job disk usage (I/O) data on IBM Spectrum Scale.
  • bjobs -o "gpfsio" displays the job-level disk usage (I/O) data on IBM Spectrum Scale.