ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6
Mellanox Technologies
39
http://www.mellanox.com => Products => Software/Drivers => InfiniBand & VPI Software/Driv-
ers => FlexBoot => Download
4.4 NVIDIA GPUDirect Support
Utilizing the high computational power of the Graphics Processing Unit (GPU), the GPU-to-GPU
method has proven valuable in various areas of science and technology. Mellanox ConnectX-2
based adapter card provides the required high throughput and low latency for GPU-to-GPU com
-
munications.
4.4.1 Hardware and Software Requirements
Software:
Operating Systems:
• RHEL5.4 2.6.18-164.el5 x86_64 or later
• Mellanox OFED with GPUDirect support
• NVIDIA Development Driver for Linux version 195.36.15 or later
Hardware:
• Mellanox ConnectX-2 adapter card
• NVIDIA Tesla series
4.4.2 Installation
For installation instructions visit: http://www.mellanox.com => Support => VPI SW/Driver.
4.4.2.1 Kernel Installation:
Use Red Hat Package Manager (RPM) to install the Kernel RPM files:
- Install the required RPMs, for example, run:
# rpm --force -ivh *.rpm
- Modify the boot loader configuration file if needed
(e.g., edit /etc/grub.conf)
- Reboot the machine with the new kernel
# reboot
4.4.2.2 MLNX OFED Drivers Installation:
The MLNX driver is called MLNX_OFED_LINUX-Nvidia-1.5.1.
- Mount the ISO file:
# mount -o ro, loop MLNX_OFED_<version>.iso /mnt
- Run the installation script:
# /mnt/mlnxofed install
- Restart the driver:
# /etc/init.d/openibd restart
- To make sure that GPUDirect is enabled, run: