Nvidia DGX H100 Service Manual

NVIDIA DGX H100 Service Manual
5. Remove the DIMM. Press down on the side latches at both ends of the DIMM socket to push
them away from the DIMM. This should unseat the DIMM from the socket.
10.3. Replacing the DIMM 63

Nvidia DGX H100 Specifications

General

GPU	8x NVIDIA H100 Tensor Core GPUs
GPU Memory	640 GB HBM3 (80GB per GPU)
System Memory	2 TB DDR5
Form Factor	6U rackmount
Storage	30TB NVMe SSD
Power Supply	10kW
Interconnect	NVLink 4.0