9.6. Launching with LSF
Open MPI supports the LSF resource manager.
9.6.1. Verify LSF support
The prte_info
command can be used to determine whether or not an
installed Open MPI includes LSF support:
shell$ prte_info | grep lsf
If the Open MPI installation includes support for LSF, you should see a line similar to that below. Note the MCA version information varies depending on which version of Open MPI is installed.
MCA ras: lsf (MCA v2.1.0, API v2.0.0, Component v3.0.0)
Note
PRRTE is the software layer that provides run-time
environment support to Open MPI. Open MPI typically hides most
PMIx and PRRTE details from the end user, but this is one place
that Open MPI is unable to hide the fact that PRRTE provides this
functionality, not Open MPI. Hence, users need to use the
prte_info
command to check for LSF support (not
ompi_info
).
9.6.2. Launching
When properly configured, Open MPI obtains both the list of hosts and
how many processes to start on each host from LSF directly. Hence, it
is unnecessary to specify the --hostfile
, --host
, or -n
options to mpirun
. Open MPI will use PBS/Torque-native mechanisms
to launch and kill processes (ssh
is not required).
For example:
Error
TODO Need LSF specific content here
# Allocate a PBS job with 4 nodes
shell$ qsub -I -lnodes=4
# Now run an Open MPI job on all the nodes allocated by PBS/Torque
shell$ mpirun mpi-hello-world
This will run the MPI processes on the nodes that were allocated by LSF. Or, if submitting a script:
Error
TODO Need LSF specific content here
shell$ cat my_script.sh
#!/bin/sh
mpirun mpi-hello-world
shell$ qsub -l nodes=4 my_script.sh