Improve performance of mbatchd query requests on UNIX
Improve mbatchd query performance on UNIX systems by using
mbatchd multithreading, hard CPU affinity, or by configuring the query proxy
daemon (lsproxyd ).
Configuring mbatchd to use multithreading
On UNIX platforms that support thread programming, you can change default mbatchd behavior to use multithreading and increase performance of query requests when you use the bjobs command. Multithreading is beneficial for busy clusters with many jobs and frequent query requests. This may indirectly increase overall mbatchd performance.
Specify hard CPU affinity
You can also specify the management host CPUs on which mbatchd child daemon query processes can run. This so-called hard CPU affinity improves mbatchd daemon scheduling and dispatch performance by binding query processes to specific CPUs so that higher priority mbatchd daemon processes can run more efficiently.
Offloading the mbatchd daemon using the LSF rate limiter (lsfproxyd daemon)
By default, all LSF batch commands contact the mbatchd
daemon (or the mbatchd
query child, if configured). When there are excessive requests, such as scripts with tight loop running bjobs commands, mbatchd
can become overloaded, negatively affecting cluster performance. Starting in Fix Pack 14, to protect mbatchd
from heavy loads, enable the LSF rate limiter (controlled by the lsfproxyd
daemon), which acts as a gatekeeper between the commands and the mbatchd
daemon. The rate limiter is supported on Linux.