IBM NeXtScale System - 50% Blocking Infiniband

148 IBM NeXtScale System Planning and Implementation Guide
5.7.2 50% blocking InfiniBand
Figure 5-20 shows a 50%-blocking (two node ports for every uplink port)
InfiniBand configuration. On the left side is a rack with six chassis for a total of 72
CPU nodes. Three 36-port InfiniBand switches and two 48-port 1 Gbps Ethernet
switches provide the network connectivity.
Figure 5-20 50% Blocking InfiniBand
36 Port IB 18 Down 18 UP
48 Port 1GBe 36 Down 2 10G Up
48 Port 1GBe 36 Down 2 10G Up
36 Port IB 18 Down 18 UP
36 Port IB 18 Down 18 UP
IB Switch 1
IB Switch 2
IB Switch 3
Cable Channel 1 Cable Channel 2
Cable Channel 3 Cable Channel 4
1
2
3
4
5
6
13
14
15
16
17
18
7
8
9
10
11
12
19
20
21
22
23
24
31
32
33
34
35
36
25
26
27
28
29
30
37
38
39
40
41
42
1G Ethernet Switch 1
1G Ethernet Switch 2
1
3
5
7
9
11
2
4
6
8
10
12
1
3
5
7
9
11
2
4
6
8
10
12
1
3
5
7
9
11
2
4
6
8
10
12
1
3
5
7
9
11
2
4
6
8
10
12
1
3
5
7
9
11
2
4
6
8
10
12
1
3
5
7
9
11
2
4
6
8
10
12
Chassis 1
Chassis 2
Chassis 3
Chassis 4
Chassis 5
Chassis 6
48 Port 1GBe 36 Down 2 10G Up
36 Port IB 18 Down 18 UP
Chassis 1
Chassis 2
48 Port 1GBe 36 Down 2 10G Up
36 Port IB 18 Down 18 UP
Chassis 3
Chassis 4
36 Port IB 18 Down 18 UP
Chassis 5
Chassis 6
Building Block 1
Building Block 2
Building Block 2
Building Block 3
Filler panel: Filler panels (part number 00Y3011) are placed in rack unit 21
and 41 to prevent hot air recirculation.