Physcial Port Label Logical Port Connection
Onboard NIC 3 (MGT
Nodes)
3
eth3
Unused
Data Network Port I I
IBS 1
Data network connection
Data Network Port II II
IBS 2
Data network connection
SAS ports A, B, C, D SAS connections (6Gbit/s or 12Gbit/s)
16.3.5 Internal Rack Cabling - Local Management Network
● Lustre 24-Port Management Network Interconnect List - Base Rack
● Lustre 24-Port Management Network Interconnect List - Storage Rack with Optional MMU
● Lustre 48-Port Management Network Interconnect List - Base Rack
● On the Ethernet switches, the ISL link connects to:
○ port 13 on each 24-port switch
○ port 37 on each 48-port switch
● Connections from the management switches to fabric switches are for managed fabric switches only. Do not
connect to Mellanox SB7790 switches, which are not managed.
● Port 17 on the base rack 24-port management switch is reserved for connection to a storage rack. Ports 5, 7,
and 19 are also available. When all available ports are used for connecting storage racks, the system may
consist of from 1 to 5 racks total.
● Ports 13, 16 through 24, 29, 31, 41, and 43 on the base rack 48-port management switch are reserved for
connections to storage racks 1 through 14. Ports 1 through 12, 14, and 15 are also available. When all
available ports are used for connecting storage racks, the system may consist of from 1 to 29 racks total.
Table 10. Lustre 24-Port Management Network Interconnect List - Base Rack
Loom Label Component Side/Port Switch Port
Blue LH Side 1 SSU0 A 2 Eth SW1 2
Blue LH Side 2 SSU1 A 2 Eth SW1 4
Blue LH Side 3 SSU2 A 2 Eth SW1 6
Blue LH Side 4 SSU3 A 2 Eth SW1 8
Blue LH Side 5 SSU4 A 2 Eth SW1 1
Blue LH Side 6 SSU5 A 2 Eth SW1 3
Blue LH Side 7 Unused Unused
Blue LH Side 8 Unused Unused
Blue LH Side 9 MMU / AMMU A 2 Eth SW1 10
Blue LH Side 10 SMU A 2 Eth SW1 9
White LH Side 11 SSU0 A 1 Eth SW0 2
Reference
102