9.8. Launching with LSF

Open MPI supports the LSF resource manager.

9.8.1. Verify LSF support

The prte_info command can be used to determine whether or not an installed Open MPI includes LSF support:

shell$ prte_info | grep lsf

If the Open MPI installation includes support for LSF, you should see a line similar to that below. Note the MCA version information varies depending on which version of Open MPI is installed.

MCA ras: lsf (MCA v2.1.0, API v2.0.0, Component v3.0.0)

Note

PRRTE is the software layer that provides run-time environment support to Open MPI. Open MPI typically hides most PMIx and PRRTE details from the end user, but this is one place that Open MPI is unable to hide the fact that PRRTE provides this functionality, not Open MPI. Hence, users need to use the prte_info command to check for LSF support (not ompi_info).

9.8.2. Launching

When properly configured, Open MPI obtains both the list of hosts and how many processes to start on each host from LSF directly. Hence, it is unnecessary to specify the --hostfile, --host, or -n options to mpirun. Open MPI will use PBS/Torque-native mechanisms to launch and kill processes (ssh is not required).

For example:

Error

TODO Need LSF specific content here

# Allocate a PBS job with 4 nodes
shell$ qsub -I -lnodes=4

# Now run an Open MPI job on all the nodes allocated by PBS/Torque
shell$ mpirun mpi-hello-world

This will run the MPI processes on the nodes that were allocated by LSF. Or, if submitting a script:

Error

TODO Need LSF specific content here

shell$ cat my_script.sh
#!/bin/sh
mpirun mpi-hello-world
shell$ qsub -l nodes=4 my_script.sh