What's new in IBM Spectrum LSF Explorer 10.2 Fix Pack 6

Edit online

The following topics summarize the new and changed behavior in IBM Spectrum LSF Explorer 10.2 Fix Pack 6.

This Fix Pack includes all fixes and enhancements that were issued in fix packs since the release of IBM Spectrum LSF Explorer 10.2. This Fix Pack also contains new enhancements and fixes issues found between October 10, 2017 and May 22, 2018. This release encompasses releases 10.2.0 and 10.2.0.6.

Download this Fix Pack 491921 from IBM Fix Central.

GPFS IO accounting and monitoring

Enhancements have been made to IBM Spectrum LSF Explorer's GPFS IO accounting and monitoring. A Workload Scale IO Accounting report has been added as a job level scale IO statistics report.

This report can be used for scenarios such as:
  • Accounting for GPFS IO usage distribution by time.
  • Charge back accounting.
  • To detect abnormal or malicious users or jobs.
  • To provide hints for system troubleshooting.
In addition, a Workload Scale IO line chart has been included in the Workload Monitor report. This chart measures:
  • Total Read Size (MB)
  • Total Write Size (MB)
  • Read Bytes Per Second
  • Write Bytes Per Second
  • Read Operations Per Second
  • Write Operations Per Second

Energy accounting enhancement for IBM Spectrum LSF

Energy consumption data is collected to provide energy accounting for the LSF bjobs command.

Energy consumption information is collected using ipmitool and is passed to the lsf-beat plug-in. The lsf-beat plug-in is controlled by lim and considers only exclusive jobs. Logstash listens on port 5043 for data generated by lsf-beat and energy data is inserted into the lsf_host_energy index. Two REST APIs are provided for LSF to show energy accounting by host and job level using the bjobs command. Elasticsearch is required for this feature.

GPU accounting enhancement

GPU related metrics are added into the Finished Job Statistics chart on the Workload Accounting dashboard for GPU accounting.

These metrics can be used for:
  • Charges on total number, execution time, energy consumption of GPU, etc.
  • Learning the GPU average SM and memory usage of jobs to perform analysis for GPU scheduling policy.

Installation and upgrade enhancements

  • The installation of IBM Spectrum LSF Explorer and IBM Spectrum LSF Application Center has been decoupled.
  • The upgrade of each rpm package individually is now supported.

UI improvements and enhancements

The look and feel of reports have been enhanced and unified:
  • Out-of-box Dashboards have been improved for a cohesive layout and style.
  • A user-input filter widget has been added to reports.

Changes to default retention period for some indices in indexpurge.conf

To avoid unchecked growth of data older data is deleted periodically by rotating indexes and deleting them after a predefined retention period. In this release, changes were made to the default retention period for some indices.

The indexpurge.conf configuration file in SERVER_TOP/lsfsuite/ext/explorer/server/config/ is used to configure the index retention period.