Nvidia ConnectX-7 User Manual

44
i.
ii.
iii.
iv.
•
ConnectX-7 Card
Configuration
Output Examples
Dual-port Socket
Direct Card (2x PCIe
x16)
[root@mftqa-009 ~]# lspci |grep mellanox -i
05:00.0 Infiniband controller: Mellanox Technologies MT2910 Family [ConnectX-7]
05:00.1 Infiniband controller: Mellanox Technologies MT2910 Family [ConnectX-7]
82:00.0 Infiniband controller: Mellanox Technologies MT2910 Family [ConnectX-7]
82:00.1 Infiniband controller: Mellanox Technologies MT2910 Family [ConnectX-7]
Intheoutput exampleabove, thefirst
tworowsindicatethatonecardisinstalledinaPCIslotwithPCIBusaddress
05(hexadecimal),PCIDevicenumber00andPCIFunctionnumber0and1.
TheothercardisinstalledinaPCIslotwithPCIBusaddress82(hexadecimal),
PCIDevicenumber00andPCIFunctionnumber0and1.
Sincethetwo PCIecards are installed intwo PCIe slots,eachcard
getsauniquePCIBusandDevicenumber.EachofthePCIex16bussesseestwo
networkports;ineffect,thetwophysicalportsoftheConnectX-7Socket
Directadapterareviewedasfournet devicesbythesystem.
Single-port PCIe x16
Card
[root@mftqa-009 ~]# lspci |grep mellanox -ia
3:00.0 Infiniband controller: Mellanox Technologies MT2910 Family [ConnectX-7]
Dual-port PCIe x16
Card
[root@mftqa-009 ~]# lspci |grep mellanox -ia
86:00.0 Network controller: Mellanox Technologies MT2910 Family [ConnectX-7]
86:00.1 Network controller: Mellanox Technologies MT2910 Family [ConnectX-7]
  2. Download the ISO image to your host.
    The image’s name has the format MLNX_OFED_LINUX-<ver>-<OS label><CPU
arch>.iso.
    You can download and install the latest OpenFabrics Enterprise Distribution (OFED)
software package available via the NVIDIA web site at nvidia.com/en-us/
networking→Products →Software→InfiniBand Drivers →NVIDIA MLNX_OFED
Scroll down to the Download wizard, and click the Download tab.
Choose your relevant package depending on your host operating system.
Click the desired ISO/tgz package.
To obtain the download link, accept the End User License Agreement (EULA).
  3. Use the Hash utility to confirm the file integrity of your ISO image. Run the following
command and compare the result to the value provided on the download page.
SHA256 MLNX_OFED_LINUX-<ver>-<OS label>.iso
Installing MLNX_OFED
Installation Script
The installation script, mlnxofedinstall, performs the following:
Discovers the currently installed kernel

Nvidia ConnectX-7 Specifications

General

Supported Protocols	Ethernet, InfiniBand
RoHS Compliance	Yes
Ports	1 or 2 ports
Data Transfer Rate	Up to 400 Gb/s
Ethernet Speeds	10/25/40/50/100/200/400
InfiniBand Speeds	400Gb/s
Latency	Sub-600 nanoseconds
Form Factor	OCP 3.0
Product Type	Network Interface Card (NIC)
Power Consumption	Varies by model and configuration