Nvidia DGX H100 User Manual

Chapter 1. Introduction to the NVIDIA
DGX H100 System
The NVIDIA DGX H100 System is the universal system purpose-built for all AI infrastructure and work-
loads, from analytics to training to inference. The system is built on eight NVIDIA H100 Tensor Core
GPUs.
1

Nvidia DGX H100 Specifications

General

GPU	8x NVIDIA H100 Tensor Core GPUs
GPU Memory	640 GB HBM3 (80GB per GPU)
System Memory	2 TB DDR5
Form Factor	6U rackmount
Storage	30TB NVMe SSD
Power Supply	10kW
Interconnect	NVLink 4.0