Nvidia DGX H100 Service Manual

NVIDIA DGX H100 Service Manual
13.8. Install the I/O Card above the ConnectX
Card
1. Reinstall the I/O card that is above the ConnectX card. Refer to one of the two following proce-
dures:
▶ M.2 boot driver carrier. Refer to M.2 Boot Drive Assembly Replacement for more information.
▶ Ethernet NIC. Refer to Network Interface Card Replacement for more information.
2. Close the motherboard tray IO door and insert the motherboard tray. Refer to Motherboard Tray
- Opening and Closing the IO door for more information.
13.9. Power on the System and Conrm the
Replacement
1. Power on and boot the system.
2. Update the rmware on the card. Refer to the NVIDIA ConnectX-7 User Guide.
3. Use the nvsm command to conrm that the system working correctly:
sudo nvsm show health
4. Use the packaging from the new component to ship the failed one back to NVIDIA Enterprise
Support.
80 Chapter 13. ConnectX-7 I/O Replacement

Nvidia DGX H100 Specifications

General

GPU	8x NVIDIA H100 Tensor Core GPUs
GPU Memory	640 GB HBM3 (80GB per GPU)
System Memory	2 TB DDR5
Form Factor	6U rackmount
Storage	30TB NVMe SSD
Power Supply	10kW
Interconnect	NVLink 4.0