Nvidia DGX H100 User Manual

Chapter 7. Security
This section provides information about security measures in the DGX H100 system.
7.1. User Security Measures
The NVIDIA DGX H100 system is a specialized server designed to be deployed in a data center. It must
be congured to protect the hardware from unauthorized access and unapproved use. The DGX H100
system is designed with a dedicated BMC Management Port and multiple Ethernet network ports.
When you install the DGX H100 system in the data center, follow best practices as established by your
organization to protect against unauthorized access.
7.1.1. Securing the BMC Port
NVIDIA recommends that you connect the BMC port in the DGX H100 system to a dedicated manage-
ment network with rewall protection.
If remote access to the BMC is required, such as for a system hosted at a co-location provider, it should
be accessed through a secure method that provides isolation from the internet, such as through a VPN
server.
7.2. System Security Measures
This section provides information about the security measures that have been incorporated in an
NVIDIA DGX H100 system.
51

Nvidia DGX H100 Specifications

General

GPU	8x NVIDIA H100 Tensor Core GPUs
GPU Memory	640 GB HBM3 (80GB per GPU)
System Memory	2 TB DDR5
Form Factor	6U rackmount
Storage	30TB NVMe SSD
Power Supply	10kW
Interconnect	NVLink 4.0