This document is a user manual for Mellanox Technologies ConnectX®-2 LX VPI Single Port QSFP InfiniBand and Ethernet Adapter Cards. It provides detailed information regarding the board's interfaces, technical specifications, required software and firmware for operation, and relevant documentation.
Function Description:
The ConnectX®-2 LX VPI Single Port QSFP InfiniBand and Ethernet Adapter Card is a versatile network adapter designed for high-performance computing environments. It supports Virtual Protocol Interconnect (VPI), allowing the card to operate as either an InfiniBand Host Channel Adapter (HCA) or an Ethernet Network Interface Card (NIC). This dual functionality provides flexibility for users to configure the port type based on their network requirements. The card is compliant with IBTA v1.2.1 for InfiniBand and IEEE Std 802.3 for Ethernet. It features a single QSFP port, which can connect to copper cables, optical cables, or SFP+ cables via a Quad to Serial (QSA) adapter. The card is designed to offload transport operations from the CPU, enhancing overall system performance. It also incorporates end-to-end Quality of Service (QoS) and congestion control, hardware-based I/O virtualization, and TCP/UDP/IP stateless offload. The card supports PCI Express 2.0 (1.1 compatible) through an x8 edge connector, capable of data transfer rates up to 5 GT/s. It is available in two bracket heights: short and tall, and also in a no-bracket configuration.
Important Technical Specifications:
- Adapter Card Models:
- MHQA19-XTR: PCIe Gen2 5.0 GT/s, 40 Gb/s QDR, 1 port, Tall bracket, RoHS R-6.
- MHQA19-XSR: PCIe Gen2 5.0 GT/s, 40 Gb/s QDR, 1 port, Short bracket, RoHS R-6.
- MHQA19-XNR: PCIe Gen2 5.0 GT/s, 40 Gb/s QDR, 1 port, No bracket, RoHS R-6.
- Physical Dimensions: 2.05 inches x 5.6 inches (52.249 mm x 142.24 mm).
- Air Flow: Minimum 200 LFM @ 55°C.
- QSFP 40Gb/s Connector: Supports InfiniBand (copper and optical) with a maximum power per port of 3.5 W. Cable power budget class 4.
- Power: 12V, 3.3V from the PCI Express Edge connector.
- Typical Power: Passive Cables 7.04W, Active Cables 9.04W.
- Maximum Power: Passive Cables 7.69W, Active Cables 9.69W.
- Operating Temperature: 0°C to 55°C.
- Protocol Support:
- InfiniBand: IBTA v1.2.1, Auto-Negotiation (20Gb/s, 5Gb/s) or (10Gb/s, 2.5Gb/s).
- QoS: 4 InfiniBand Virtual Lanes.
- Data Rate: QDR.
- PCI Express: 2.0 SERDES @ 5.0 GT/s.
- Memory: Supports multiple memory devices through PCI Flash and I2C compatible interfaces. Includes one 16MB SPI Flash device.
- EEPROM: 4Kb capacity for Vital Product Data (VPD), compliant with PCI 2.3 Specification, Appendix I.
- Regulatory Compliance:
- EMC: FCC 47 CFR part 15:2006 (subpart B, class A), ICES-003:2004 Issue 4 (class A), VCCI V-3/2007.04 (class A), EN 55022:1998+A1:2000+A2:2003 (class A), EN 61000-3-2:2000+A2:2005, EN61000-3-3:1995+A2:2005, EN 55024:1998+A1:2001+A2:2003 standards, harmonized under EMC Directive 2004/108/EC Article 6(2); AS/NZS 3548.
- Safety: IEC/EN 60950-1:2006, ETSI EN 300 019-2-2, IEC 60068-2-64, 29, 32.
- RoHS: RoHS-R6.
Usage Features:
- VPI Port Configuration: The VPI port is auto-sensing, but can be manually configured as "eth" (Always Ethernet), "ib" (Always InfiniBand), or "auto" (Link sensing mode). Configuration is managed via the
connectx_port_config script.
- LED Indicators: The I/O panel features green and yellow LEDs. A constant green LED indicates a good physical link, while blinking green indicates a physical link problem. A constant yellow LED indicates a valid data activity link without data transfer, and a blinking yellow LED indicates data transfer.
- FlexBoot: Enables remote boot over Ethernet or InfiniBand using Boot over InfiniBand (BoIB), Boot over Ethernet (BoE), or Boot over iSCSI (Bo-iSCSI), based on the Pre-boot Execution Environment (PXE) standard.
- Cable Compatibility: QSFP ports support InfiniBand passive copper cables, active copper cables, and optical cables. Hybrid QSFP to SFP+ cables are also supported. Optical modules (MFM4R12C-QDR) and QSFP to SFP+ adapters (QSA) are available.
- Hot-Plugging: Cables can be inserted or removed with the unit powered on.
- Driver Software: Mellanox OFED for Linux and Mellanox WinOF VPI for Windows are available for download from the Mellanox website.
- Firmware Updates: Firmware can be updated using the
flint tool from the Mellanox Firmware Tools (MFT) package. Users are advised to check the Mellanox website for the latest firmware versions.
- System Identification: Instructions are provided for identifying the card in Windows (Device Manager) and Linux (
lspci, ethtool, ibstat).
Maintenance Features:
- Bracket Replacement: Detailed instructions are provided for replacing a tall bracket with a short bracket, including steps for removing screws, handling the gasket, and aligning LEDs.
- Cable Installation/Removal: Emphasizes careful handling of copper cables due to their weight and rigidity, recommending support for the cable's weight and proper orientation during insertion.
- Safety Warnings: Comprehensive safety warnings are provided in English, French, German, and Spanish, covering:
- Installation Instructions: Read all instructions before connecting to power.
- Over-temperature: Do not operate above 55°C (131°F); ensure 200 LFM airflow and 8 cm (3 inches) clearance around ventilation openings.
- Lightning - Electrical Hazard: Do not work on equipment or connect/disconnect cables during lightning activity.
- Copper Cable Connecting/Disconnecting: Handle heavy and inflexible copper cables carefully; refer to cable manufacturer warnings.
- Equipment Installation: Installation, replacement, or servicing should only be performed by trained and qualified personnel.
- Equipment Disposal: Dispose of equipment according to national laws and regulations.
- Local and National Electrical Codes: Install equipment in compliance with local and national electrical codes.
- Technical Support: Customers can contact Mellanox directly via URL, email, or phone, or through approved resellers.
- Firmware and Software Updates: Access to the Mellanox support downloader for software, firmware, and knowledge database information.