Nvidia DGX H100 Service Manual

NVIDIA DGX H100 Service Manual
▶ After the triangular markers align, lift the tray lid to remove it.
4. Optional: Depending on the procedure that you need to perform, remove the air baes from the
motherboard.
5.5. Close the Motherboard Tray Lid
Before you perform the following steps, ensure that all components are installed correctly so that they
do not interfere with the air baes or tray lid.
1. Insert the motherboard tray baes and then place the tray lid over the motherboard tray.
2. To close the tray lid, perform the following motions:
▶ Position the tray lid correctly by aligning the markers as shown in the following gure.
▶ Push the tray lid toward the IO section of the tray until the folding section is ush.
▶ Press the folding section down so that the thumbscrews align with the screw holes.
5.5. Close the Motherboard Tray Lid 31

Nvidia DGX H100 Specifications

General

GPU	8x NVIDIA H100 Tensor Core GPUs
GPU Memory	640 GB HBM3 (80GB per GPU)
System Memory	2 TB DDR5
Form Factor	6U rackmount
Storage	30TB NVMe SSD
Power Supply	10kW
Interconnect	NVLink 4.0