Nvidia DGX B200 - User Manual

To Next Page

NVIDIA DGX B200 User Guide

NVIDIA Corporation

Jan 24, 2025

Main Page

Table of Contents3
Chapter 1. Introduction to NVIDIA DGX B200 Systems9
Hardware Overview9
DGX B200 Component Descriptions9
Mechanical Specifications10
Power Specifications11
Support for PSU Redundancy and Continuous Operation11
DGX B200 Locking Power Cord Specification11
Using the Locking Power Cords12
Environmental Specifications13
Front Panel Connections and Controls13
With a Bezel13
With the Bezel Removed14
Rear Panel Modules15
Motherboard Connections and Controls15
Motherboard Tray Components16
GPU Tray Components16
Network Connections, Cables, and Adaptors17
Network Ports17
Compute and Storage Networking18
Network Modules19
BMC Port Leds20
Supported Network Cables and Adaptors20
DGX B200 System Topology20
DGX os Software21
Customer Support21
Chapter 2. Connecting to DGX B20023
Connecting to the Console23
Direct Connection23
Remote Connection through the BMC24
SSH Connection to the os26
Chapter 3. First Boot Setup27
System Setup27
Post Setup Tasks29
Obtaining Software Updates29
Enabling the SRP Daemon29
Chapter 4. Quickstart and Basic Operation31
Installation and Configuration31
Registration31
Obtaining an NGC Account32
Turning DGX B200 on and off32
Startup Considerations32
Shutdown Considerations32
Verifying Functionality - Quick Health Check32
Running the Pre-Flight Test33
Running NGC Containers with GPU Support34
Using Native GPU Support34
Using the NVIDIA Container Runtime for Docker35
Managing CPU Mitigations36
Determining the CPU Mitigation State of the DGX System36
Disabling CPU Mitigations37
Re-Enabling CPU Mitigations37
Chapter 5. SBIOS Settings39
Accessing the SBIOS Setup39
Configuring the Boot Order40
Configuring the Local Terminal42
Linux42
Windows and Macos42
Power on or Reboot the System42
Chapter 6. Using the Baseboard Management Controller (BMC)45
Connecting to the BMC45
Overview of BMC Controls46
Open Ports49
Configuring a Static IP Address for the BMC49
Configuring a BMC Static Address by Using Ipmitool50
Configuring a BMC Static IP Address by Using the System BIOS50
Changing the BMC Login Credentials51
Username and Password Requirements51
Procedure51
Using the Remote Console52
Setting up Active Directory, LDAP, or E-Directory52
Configuring Platform Event Filters52
Uploading or Generating SSL Certificates53
Viewing the SSL Certificate54
Generating the SSL Certificate54
Uploading the SSL Certificate55
Updating the SBIOS Certificate56
Chapter 7. Managing Power Capping61
Querying the Current GPU Power Limit61
Managing N+N Configuration (IPMI)62
Managing Power Capping Using Redfish API63
Chapter 8. Security65
User Security Measures65
Securing the BMC Port65
System Security Measures65
Secure Flash of DGX B200 Firmware66
Encryption66
NVIDIA System Manager Security66
Secure Data Deletion66
Prerequisites66
Procedure67
Chapter 9. Redfish Apis Support69
Supported Redfish Features69
Connectivity between the Host and BMC70
Redfish Examples70
BMC Manager70
Firmware Update71
BIOS Settings73
Modifying the Boot Order Using Redfish74
Telemetry77
Chassis77
SEL Logs78
Virtual Image78
Backing up and Restoring BMC Configurations79
Backing up the BMC Configuration79
Restoring the BMC Configuration79
Collecting BMC Debug Data80
Clear BIOS and Reset to Factory Defaults81
Querying GPU Power Limit81
Power Capping82
Services82
Domains82
Custom Policies85
PSU Policies88
Chapter 10. Safety95
Safety Information95
Safety Warnings and Cautions95
Intended Application Uses97
Site Selection98
Equipment Handling Practices98
Electrical Precautions98
Power and Electrical Warnings98
Power Cord Warnings99
System Access Warnings99
Rack Mount Warnings100
Electrostatic Discharge101
Other Hazards101
California Department of Toxic Substances Control101
Nickel101
Battery Replacement102
Cooling and Airflow102
Chapter 11. Compliance103
United States103
United States/Canada103
Canada104
Australia and New Zealand105
Brazil105
Japan105
South Korea107
China108
Taiwan109
Russia/Kazakhstan/Belarus110
Israel111
India111
South Africa112
Great Britain (England, Wales, and Scotland)112
Chapter 12. Third-Party License Notices113
Micron Msecli113
Mellanox (OFED)114
Chapter 13. Notices115
Notice115
Trademarks116

Brand	Nvidia
Model	DGX B200
Category	Computer Hardware
Language	English

Nvidia DGX B200 - User Manual

Table of Contents

Nvidia DGX B200 Specifications

Related product manuals