Enabling daemon log files for diagnostics

LSF provides daemon monitoring mechanisms for mbatchd and, starting in Fix Pack 14, for lsfproxyd, to log information and help administer or support diagnosing problems with clusters when using these daemons. The LSF rate limiter is manged by the lsfproxyd daemon.

About this task

The mbatchd daemon log file is called query_info.querylog.hostname. The log files show information about mbatchd requests: who issued these requests, where the requests came from, and the data size of the query. The format of the information provided in the log file is DATE TIME YEAR COMMAND,USER,HOSTNAME,SIZE,OPTION.

The lsfproxyd daemon log file for the LSF rate limiter, and is called query_info.queryproxylog.hostname. The log files show information about lsfproxyd requests: where the requests came from, the data size of the request, the batch operation code, whether the request was rejected or accepted, and the time that the lsfproxyd daemon receives and processes the requests. The format of the information provided in the log file is DATE TIME YEAR BATCH_OPCODE,USER,HOSTNAME,SIZE,ACCEPT,RECEIVE TIME,PROCESS TIME.

There are two ways to enable daemon log files: statically and dynamically.

Procedure

  • Statically:
    • For the mbatchd daemon log file, set ENABLE_DIAGNOSE=query in the lsb.params configuration file.
    • For the lsfproxyd daemon log file, set the ENABLE_DIAGNOSE=lsfproxyd in the lsb.params configuration file.
    • For both the mbatchd daemon and lsfproxyd daemon log files, set ENABLE_DIAGNOSE="query lsfproxyd" in the lsb.params configuration file.
    The log files save to the default LSF log directory (LSF_LOGDIR). To change this log location, defined the DIAGNOSE_LOGDIR parameter in the lsb.params configuration file.
  • Dynamically:
    • For the mbatchd daemon log file, run the badmin diagnose -c query command.
    • For the lsfproxyd daemon log file, run the badmin diagnose -c lsfproxyd command.

    The dynamic method overrides the static settings. However, if you restart or reconfigure mbatchd or lsfproxyd, it switches back to the static diagnosis settings.