IBM NeXtScale System User Manual

Chapter 5. Rack planning 147
For more information about networking with IBM NeXtScale System, see IBM
NeXtScale System Network and Management Cable Guide, PRS4401, which is
available at this website:
http://ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS4401
5.7.1 Non-blocking InfiniBand
Figure 5-19 shows a non-blocking InfiniBand configuration. On the left side is a
rack with six chassis for a total of 72 compute nodes. Four 36-port InfiniBand
switches and two 48-port 1 Gb Ethernet switches are used.
Figure 5-19 Non-blocking InfiniBand
36 Port IB 18 Down 18 UP
36 Port IB 18 Down 18 UP
48 Port 1GBe 36 Down 2 10G Up
48 Port 1GBe 36 Down 2 10G Up
36 Port IB 18 Down 18 UP
36 Port IB 18 Down 18 UP
IB Switch 1
IB Switch 2
IB Switch 3
IB Switch 4
Cable Channel 1 Cable Channel 2
Cable Channel 3 Cable Channel 4
1
2
3
4
5
6
13
14
15
16
17
18
7
8
9
10
11
12
19
20
21
22
23
24
31
32
33
34
35
36
25
26
27
28
29
30
37
38
39
40
41
42
1G Ethernet Switch 1
1G Ethernet Switch 2
1
3
5
7
9
11
2
4
6
8
10
12
1
3
5
7
9
11
2
4
6
8
10
12
1
3
5
7
9
11
2
4
6
8
10
12
1
3
5
7
9
11
2
4
6
8
10
12
1
3
5
7
9
11
2
4
6
8
10
12
1
3
5
7
9
11
2
4
6
8
10
12
Chassis 1
Chassis 2
Chassis 3
Chassis 4
Chassis 5
Chassis 6
36 Port IB 18 Down 18 UP
48 Port 1GBe 36 Down 2 10G Up
36 Port IB 18 Down 18 UP
Chassis 1
Chassis 2
Chassis 3
36 Port IB 18 Down 18 UP
48 Port 1GBe 36 Down 2 10G Up
36 Port IB 18 Down 18 UP
Chassis 4
Chassis 5
Chassis 6
Building Block 1
Building Block 2

IBM NeXtScale System Specifications

General

Brand	IBM
Model	NeXtScale System
Category	Server
Language	English