Monitoring IBM Spectrum LSF cluster operations and health

Learn how to monitor cluster performance, job resource usage, and other information about queues, jobs, and users.

Monitor cluster performance
Use badmin perfmon to monitor cluster performance. Use badmin diagnose to troubleshoot cluster problems.
Monitor job information
Use bjobs and bhist to monitor the current and past status of jobs and job arrays. The bjdepinfo command displays any dependencies that jobs have, either jobs that depend on a job or jobs that your job depends on. View suspending conditions using bhosts -l and bqueues -l. Run bjobs -lp to see the reason a job was suspended. Run bjobs -l to see the scheduling thresholds that control when a job is resumed display.
Monitor applications by using external scripts
Use the watchdog feature to regularly run external scripts that check application information and to pass on the job information as notifications.
View information about resources
Use the bhosts command to view information about shared resources on hosts and load on a host. Use the bjobs command to see job resource usage. Use the lsinfo command to see overall cluster resources, and the lshosts command to see host-based resources and host load by resource.
View user and user group information
Use the busers and bugroup commands to display information about LSF users and user groups.
View queue information
The bqueues command displays information about queues. The bqueues -l option also gives current statistics about the jobs in a particular queue, such as the total number of jobs in the queue, the number of running and suspended jobs.

Parent topic: Administer IBM Spectrum LSF