Connecting an Expansion Rack to Oracle SuperCluster T5-8
From InfiniBand
Switch Rack Unit
Port To Rack Unit Type of Equipment Port Cable Description
U20 9A U24 Sun Datacenter InfiniBand
Switch 36 switch
9B 2 meter QDR InfiniBand cable
U20 10A U24 Sun Datacenter InfiniBand
Switch 36 switch
10B 2 meter QDR InfiniBand cable
U20 11A U24 Sun Datacenter InfiniBand
Switch 36 switch
11B 2 meter QDR InfiniBand cable
Connecting an Expansion Rack to Oracle SuperCluster T5-8
You connect an expansion rack to Oracle SuperCluster T5-8 using three Sun Datacenter
InfiniBand Switch 36 switches. Oracle SuperCluster T5-8 and the Oracle Exadata Storage
Expansion Half Rack or Oracle Exadata Storage Expansion Full Rack include three Sun
Datacenter InfiniBand Switch 36 switches. Two switches are used as leaf switches, and the third
switch is used as a spine switch. These switches attach to standard Quad Small Form-factor
Pluggable (QSFP) connectors at the end of the InfiniBand cables. The procedures in this section
assume the racks are adjacent to each other. If they are not, then longer cables may be required
for the connections.
Note - The Oracle Exadata Storage Expansion Quarter Rack contains only two Sun Datacenter
InfiniBand Switch 36 switches (the leaf switches), so no spine switch is available in the
Oracle Exadata Storage Expansion Quarter Rack. See “Connecting an Oracle Exadata Storage
Expansion Quarter Rack to Oracle SuperCluster T5-8” on page 316 for more information.
InfiniBand Switch Information for Oracle
SuperCluster T5-8
In Oracle SuperCluster T5-8, the switch at rack unit 1 (U1) is referred to as the spine switch.
The switches at rack unit 26 (U26) and rack unit 32 (U32) are referred to as leaf switches. In
a single rack, the two leaf switches are interconnected using seven connections. In addition,
each leaf switch has one connection to the spine switch. The leaf switches connect to the spine
switch as shown in the following graphic.
Connecting Expansion Racks 315