Nvidia DGX H100 Service Manual

NVIDIA DGX H100 Service Manual
5. Make sure the cable is locked to the connector on the board:
13.7. Install ConnectX Card
1. After you connect the IPEX cables, install the new card in the slot:
2. Conrm the card is in place and that the cables are connected:
13.7. Install ConnectX Card 79

Nvidia DGX H100 Specifications

General

GPU	8x NVIDIA H100 Tensor Core GPUs
GPU Memory	640 GB HBM3 (80GB per GPU)
System Memory	2 TB DDR5
Form Factor	6U rackmount
Storage	30TB NVMe SSD
Power Supply	10kW
Interconnect	NVLink 4.0