Table 72. Supported memory matrix
DIMM type Rank Capacity DIMM rated
voltage and
speed
Operating Speed
1 DIMM per
channel (DPC)
2 DIMMs per
channel (DPC)
RDIMM 2 R 32 GB, 64 GB DDR5 (1.1 V), 4800
MT/s
4800 MT/s 4400 MT/s
4 R 128 GB DDR5 (1.1 V), 4800
MT/s
4800 MT/s 4400 MT/s
NOTE: The processor may reduce the performance of the rated DIMM speed.
NOTE: Maximum DIMM transfer speed support dependent on CPU SKU and DIMM population.
General memory module installation guidelines
To ensure optimal performance of your system, observe the following general guidelines when configuring your system memory.
If your system's memory configuration fails to observe these guidelines, your system might not boot, stop responding during
memory configuration, or operate with reduced memory.
The memory bus may operate at speeds of 4800 MT/s depending on the following factors:
● System profile selected (for example, Performance, Performance Per Watt Optimized (OS), or Custom [can be run at high
speed or lower])
● Maximum supported DIMM speed of the processors
● Maximum supported speed of the DIMMs
NOTE: MT/s indicates DIMM speed in MegaTransfers per second.
The following are the recommended guidelines for installing memory modules:
● All DIMMs must be DDR5.
● If memory modules with different speeds are installed, they operate at the speed of the slowest installed memory module(s).
● Populate memory module sockets only if a processor is installed.
○ For dual-processor systems, sockets A1 to A16 and sockets B1 to B16 are available.
● In Optimizer Mode, the DRAM controllers operate independently in the 64-bit mode and provide optimized memory
performance.
Table 73.
Memory population rules
Processor Memory population Memory population information
Dual processor (Start with processor1.
Processor 1 and processor 2 population
should match)
A{1}, B{1}, A{2}, B{2}, A{3},B{3}, A{4},
B{4}, A{5}, B{5},A{6}, B{6}, A{7}, B{7}
A{8},B{8}, A{9}, B{9}, A{10},B{10},
A{11}, B{11}, A{12}, B{12}, A{13}, B{13},
A{14},B{14}, A{15}, B{15}, A{16},B{16}
16 or 32 DIMMs are supported per
system.
● Populate all the sockets with white release tabs first, followed by the sockets with black release tabs.
● Mixing of any different memory module capacities is not supported.
● Supported RDIMM configurations are 8 or 16 DIMMs per processor.
NOTE: NVIDIA recommend minimum 1TB system memory for H100 (80GB) -8 GPU and A100 (80GB) - 8 GPU
Removing a memory module
Prerequisites
1. Follow the safety guidelines listed in the Safety instructions.
2. Follow the procedure listed in the Before working inside your system.
3. Remove the air shroud .
142
Installing and removing system components