Nvidia DGX H100 Service Manual

NVIDIA DGX H100 Service Manual
2. Before you pull the card too far, remove the white and black IPEX cables from the card.
The white cable connects on top of the card and the black cable connects on the bottom
(heatsink) of the card:
3. Follow the instructions in the next steps to remove and insert the IPEX connectors.
13.5. Remove an IPEX Cable
Repeat this process for both white and black cables.
1. Lift the locking door:
13.5. Remove an IPEX Cable 77

Nvidia DGX H100 Specifications

General

GPU	8x NVIDIA H100 Tensor Core GPUs
GPU Memory	640 GB HBM3 (80GB per GPU)
System Memory	2 TB DDR5
Form Factor	6U rackmount
Storage	30TB NVMe SSD
Power Supply	10kW
Interconnect	NVLink 4.0