QLogic 7104-1M-CABLE User Manual
6–Configuring Drivers and Services
OpenFabrics Drivers and Services Configuration and Startup
IB0056101-00 H
6-13
A
More information for configuration, starting and stopping the interface, and basic
troubleshooting is found in the QLogic OFED+ User Guide.
troubleshooting is found in the QLogic OFED+ User Guide.
MPI over uDAPL
Intel MPI can be run over uDAPL, which uses IB Verbs. uDAPL is the user mode
version of the Direct Access Provider Library (DAPL), and is provided as a part of
the OFED packages. You will also have to have IPoIB configured.
version of the Direct Access Provider Library (DAPL), and is provided as a part of
the OFED packages. You will also have to have IPoIB configured.
The setup for Intel MPI is described in the following steps:
1.
Make sure that DAPL 1.2 (not version 2.0) is installed on every node. In this
release they are called compat-dapl. (Both versions are supplied with the
release they are called compat-dapl. (Both versions are supplied with the
OpenFabrics RPMs.) They can be installed either with the installer with the
QLogicIB-Basic package or with rpm with the QLogic OFED 1.4 RPM set.
QLogicIB-Basic package or with rpm with the QLogic OFED 1.4 RPM set.
For example:
$ rpm -qa | grep compat-dapl
compat-dapl-1.2.12-1.x86_64.rpm
compat-dapl-debuginfo-1.2.12-1.x86_64.rpm
compat-dapl-devel-1.2.12-1.x86_64.rpm
compat-dapl-devel-static-1.2.12-1.x86_64.rpm
compat-dapl-utils-1.2.12-1.x86_64.rpm
compat-dapl-1.2.12-1.x86_64.rpm
compat-dapl-debuginfo-1.2.12-1.x86_64.rpm
compat-dapl-devel-1.2.12-1.x86_64.rpm
compat-dapl-devel-static-1.2.12-1.x86_64.rpm
compat-dapl-utils-1.2.12-1.x86_64.rpm
2.
Verify that there is a /etc/dat.conf file. It should be installed by the
dapl- RPM. The file dat.conf contains a list of interface adapters
dapl- RPM. The file dat.conf contains a list of interface adapters
supported by uDAPL service providers. In particular, it must contain
mapping entries for OpenIB-cma for dapl 1.2.x, in a form similar to this
mapping entries for OpenIB-cma for dapl 1.2.x, in a form similar to this
(all on one line):
OpenIB-cma u1.2 nonthreadsafe default libdaplcma.so.1 dapl.1.2
"ib0 0" ""
"ib0 0" ""
3.
On every node, type the following command (as a root user):
# modprobe rdma_ucm
To ensure that the module is loaded when the driver is loaded, add
RDMA_UCM_LOAD=yes to the /etc/infiniband/openib.conf file.
RDMA_UCM_LOAD=yes to the /etc/infiniband/openib.conf file.
(Note that rdma_cm is also used, but it is loaded automatically.)
4.
Bring up an IPoIB interface on every node, for example, ib0. See the
instructions for configuring IPoIB for more details.
For more information on using Intel MPI, see the “Using Other MPIs” section in the
QLogic Host Channel Adapter and QLogic OFED Software Users Guide.
QLogic Host Channel Adapter and QLogic OFED Software Users Guide.