Nvidia DGX A100

Introduction to the NVIDIA DGX A100 System
NVIDIA DGX A100 DU-09821-001 _v01|3
Component Description
Table2. Component Description
Component Description
GPU NVIDIA A100 GPU
CPU 2x AMD EPYC 7742 CPU w/64 cores
NVSwitch 600 GB/s GPU-to-GPU bandwidth
Storage (OS) 1.92 TB NVMe M.2 SSD (ea) in RAID 1 array
Storage (Data Cache)
3.84 TB NVMe U.2 SED (ea) in RAID 0 array
(Optional 7.68 TB NVMe U.2. SEDs)
Network (Cluster) card
NVIDIA ConnectX-6 or ConnectX-7 Single Port
InfiniBand (default): Up to 200Gbps
Ethernet: 200GbE, 100GbE, 50GbE, 40GbE, 25GbE,
and 10GbE
Network (Storage) card
NVIDIA ConnectX-6 or ConnectX-7 Dual Port
Ethernet (default): 200GbE, 100GbE, 50GbE,
40GbE, 25GbE, and 10GbE
InfiniBand: Up to 200Gbps
System Memory (DIMM) 1 TB per 16 DIMMs
BMC (out-of-band system management)
1 GbE RJ45 interface
Supports IPMI, SNMP, KVM, and Web UI
In-band system management 1 GbE RJ45 interface
Power Supply 3 kW
1.1.2. Mechanical Specifications
Here is some information about mechanical specifications.
Table3. Mechanical Specifications
Feature Description
Form Factor 6U Rackmount
Height 10.4” (264 mm)
Width 19" (482.3 mm) max