Enhance fair share calculation to include the job forwarding mode

You can enhance the calculations for the fair share policies to account for the forwarding mode in the LSF multicluster capability, which charges the user priority for each job forwarded, providing a fair opportunity for all users to forward their jobs. This policy charges the priority of the user whose job is successfully forwarded to the remote execution cluster, and restores the charge for the user whose job is returned from the remote execution cluster.

See more information on global fair share scheduling in Global fair share scheduling.

Enabling and configuring fair share scheduling for the LSF multicluster capability job forwarding model

Include forwarded jobs for the LSF multicluster capability in the fair share calculations by defining the following parameters:

  • FWD_JOB_FACTOR=number in the lsb.params or lsb.queues files.

    Specify the weighting factor to indicate the relative importance of the number of forwarded job slots in the user priority calculation. Set this parameter cluster-wide in the lsb.params file, or for an individual queue in the lsb.queues file. If defined in both files, the queue value takes precedence. To treat remote jobs and local jobs as the same, set FWD_JOB_FACTOR to the same value as RUN_JOB_FACTOR unless you want a different weighting factor for forwarded jobs.

  • LSF_MC_FORWARD_fair share_CHARGE_DURATION=seconds in the lsf.conf file.

    When accounting for forwarded jobs in the fair share calculations, job usage might be counted twice if global fair share is used because job usage is counted on the submission cluster, then counted again when the job is running on a remote cluster. To avoid this problem, specify the duration of time after which LSF removes the forwarded jobs from the user priority calculation for fair share scheduling by specifying the LSF_MC_FORWARD_fair share_CHARGE_DURATION parameter in the lsf.conf file. If you enabled global fair share and intend to use the new forwarded job slots factor, set the value of LSF_MC_FORWARD_fair share_CHARGE_DURATION to double the value of the SYNC_INTERVAL parameter in the lsb.globalpolicies file (approximately 5 minutes) to avoid double-counting the job usage for forwarded jobs. If global fair share is not enabled, this parameter is not needed.