Skip to content

Commit f53a4f2

Browse files
authored
Merge pull request #6270 from jsquyres/pr/remove-openib-and-affiliated-stuff
So long, openib, and thanks for all the fish.
2 parents ead2efb + 99553eb commit f53a4f2

File tree

99 files changed

+5
-25722
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

99 files changed

+5
-25722
lines changed

README

Lines changed: 4 additions & 62 deletions
Original file line numberDiff line numberDiff line change
@@ -623,7 +623,6 @@ MPI Functionality and Features
623623
- portals4
624624

625625
(2) The ob1 PML and the following BTLs support MPI_THREAD_MULTIPLE:
626-
- openib (see exception below)
627626
- self
628627
- sm
629628
- smcuda
@@ -632,10 +631,6 @@ MPI Functionality and Features
632631
- usnic
633632
- vader (shared memory)
634633

635-
The openib BTL's RDMACM based connection setup mechanism is also not
636-
thread safe. The default UDCM method should be used for
637-
applications requiring MPI_THREAD_MULTIPLE support.
638-
639634
Currently, MPI File operations are not thread safe even if MPI is
640635
initialized for MPI_THREAD_MULTIPLE support.
641636

@@ -794,7 +789,8 @@ Network Support
794789
- In prior versions of Open MPI, InfiniBand and RoCE support was
795790
provided through the openib BTL and ob1 PML plugins. Starting with
796791
Open MPI 4.0.0, InfiniBand support through the openib plugin is both
797-
deprecated and superseded by the ucx PML component.
792+
deprecated and superseded by the ucx PML component. The openib BTL
793+
was removed in Open MPI v5.0.0.
798794

799795
While the openib BTL depended on libibverbs, the UCX PML depends on
800796
the UCX library.
@@ -809,15 +805,6 @@ Network Support
809805
for OpenSHMEM support, and "--mca osc ucx" for MPI RMA (one-sided)
810806
operations.
811807

812-
- Although the ob1 PML+openib BTL is still the default for iWARP and
813-
RoCE devices, it will reject InfiniBand defaults (by default) so
814-
that they will use the ucx PML. If using the openib BTL is still
815-
desired, set the following MCA parameters:
816-
817-
# Note that "vader" is Open MPI's shared memory BTL
818-
$ mpirun --mca pml ob1 --mca btl openib,vader,self \
819-
--mca btl_openib_allow_ib 1 ...
820-
821808
- The usnic BTL is support for Cisco's usNIC device ("userspace NIC")
822809
on Cisco UCS servers with the Virtualized Interface Card (VIC).
823810
Although the usNIC is accessed via the OpenFabrics Libfabric API
@@ -850,8 +837,8 @@ Network Support
850837

851838
http://lwn.net/Articles/343351/
852839

853-
- The use of fork() with OpenFabrics-based networks (i.e., the openib
854-
BTL) is only partially supported, and only on Linux kernels >=
840+
- The use of fork() with OpenFabrics-based networks (i.e., the UCX
841+
PML) is only partially supported, and only on Linux kernels >=
855842
v2.6.15 with libibverbs v1.1 or later (first released as part of
856843
OFED v1.2), per restrictions imposed by the OFED network stack.
857844

@@ -1206,51 +1193,6 @@ NETWORKING SUPPORT / OPTIONS
12061193
--with-usnic
12071194
Abort configure if Cisco usNIC support cannot be built.
12081195

1209-
--with-verbs=<directory>
1210-
Specify the directory where the verbs (also known as OpenFabrics
1211-
verbs, or Linux verbs, and previously known as OpenIB) libraries and
1212-
header files are located. This option is generally only necessary
1213-
if the verbs headers and libraries are not in default
1214-
compiler/linker search paths.
1215-
1216-
The Verbs library usually implies operating system bypass networks,
1217-
such as InfiniBand, usNIC, iWARP, and RoCE (aka "IBoIP").
1218-
1219-
--with-verbs-libdir=<directory>
1220-
Look in directory for the verbs libraries. By default, Open MPI
1221-
will look in <verbs_directory>/lib and <verbs_ directory>/lib64,
1222-
which covers most cases. This option is only needed for special
1223-
configurations.
1224-
1225-
--with-verbs-usnic
1226-
Note that this option is no longer necessary in recent Linux distro
1227-
versions. If your Linux distro uses the "rdma-core" package (instead
1228-
of a standalone "libibverbs" package), not only do you not need this
1229-
option, you shouldn't use it, either. More below.
1230-
1231-
This option will activate support in Open MPI for disabling a
1232-
dire-sounding warning message from libibverbs that Cisco usNIC
1233-
devices are not supported (because Cisco usNIC devices are supported
1234-
through libfabric, not libibverbs). This libibverbs warning can
1235-
also be suppressed by installing the "no op" libusnic_verbs plugin
1236-
for libibverbs (see https://github.com/cisco/libusnic_verbs, or
1237-
download binaries from cisco.com).
1238-
1239-
This option is disabled by default for two reasons:
1240-
1241-
1. It causes libopen-pal.so to depend on libibverbs.so, which is
1242-
undesirable to many downstream packagers.
1243-
2. As mentioned above, recent versions of the libibverbs library
1244-
(included in the "rdma-core" package) do not have the bug that
1245-
will emit dire-sounding warnings about usnic devices. Indeed,
1246-
the --with-verbs-usnic option will enable code in Open MPI that
1247-
is actually incompatible with rdma-core (i.e., cause Open MPI to
1248-
fail to compile).
1249-
1250-
If you enable --with-verbs-usnic and your system uses the rdma-core
1251-
package, configure will safely abort with a helpful message telling
1252-
you that you should not use --with-verbs-usnic.
1253-
12541196

12551197
RUN-TIME SYSTEM SUPPORT
12561198

VERSION

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -114,4 +114,3 @@ libmca_opal_common_ofi_so_version=0:0:0
114114
libmca_opal_common_sm_so_version=0:0:0
115115
libmca_opal_common_ucx_so_version=0:0:0
116116
libmca_opal_common_ugni_so_version=0:0:0
117-
libmca_opal_common_verbs_so_version=0:0:0

0 commit comments

Comments
 (0)