Running parallel jobs
LSF
provides a generic interface to parallel programming packages so that any parallel package can be
supported by writing shell scripts or wrapper programs.
How LSF runs parallel jobs Preparing your environment to submit parallel jobs to LSF Submit a parallel job Start parallel tasks with LSF utilities Job slot limits for parallel jobs Specify a minimum and maximum number of tasks Restrict job size requested by parallel jobs LSF to check the requested job sizes when submitting, modifying, or switching jobs.About specifying a first execution host Compute units Control processor allocation across hosts Run parallel processes on homogeneous hosts Limit the number of processors allocated Limit the number of allocated hosts Reserve processors Reserve memory for pending parallel jobs Backfill scheduling How deadline constraint scheduling works for parallel jobs Optimized preemption of parallel jobs Controlling CPU and memory affinity IBM® Spectrum LSF can schedule jobs that are affinity aware. This allows jobs to take advantage of different levels of processing units (NUMA nodes, sockets, cores, and threads). Affinity scheduling is supported only on Linux and Power 7 and Power 8 hosts. Affinity scheduling is supported in LSF Standard Edition and LSF Advanced Edition. Affinity scheduling is not supported on LSF Express Edition.Processor binding for LSF job processes Running parallel jobs with blaunch LSF . Task geometry allows for flexibility in how tasks are grouped for execution on system nodes. A typical LSF parallel job launches its tasks across multiple hosts. By default you can enforce limits on the total resources used by all the tasks in the job.Running MPI workload through IBM Parallel Environment Runtime Edition IBM Spectrum LSF integrates with the IBM Parallel Environment Runtime Edition (IBM PE Runtime Edition) program product - Version 1.3 or later to run PE jobs through the IBM Parallel Operating Environment (POE). The integration enables network-aware scheduling, allowing an LSF job to specify network resource requirements, collect network information, and schedule the job according to the requested network resources.