net4 Infiniband up 32000 unknown ibp0
net5 Infiniband up 32000 unknown ibp1
4. Open a second terminal and log in as root to the switch net5 is connected to
(el01sw-ib02 for this example).
Run the showvlan command to verify that the VLAN 0 is associated with the
default partition and that the VLAN ID is created on the correct IB partition. The
following example displays the output from this command showing that the VLAN
ID is 3066 and it's associated to the correct IB partition:
[root@el01sw-ib02 ~]# showvlan
Connector/LAG VLN PKEY
------------- --- ------
0A-ETH-1 0 0xffff
0A-ETH-1 3066 0x8206
5.
Repeat the previous step on the switch net4 is connected to (el01sw-ib03 for this
example).
6.
From the compute node session, use the dladm command to verify that the
compute node GUIDs are included in the IB partition that the VLAN 3066 is using.
See the following extract of the command output for net4 and net5:
root@el01cn16:~# dladm show-ib net4
LINK HCAGUID PORTGUID PORT STATE GWNAME GWPORT PKEYS
net4 2128000... 21280001EFF369 1 up el01sw-ib02 0a-eth-1 7FFF,8206,FFFF
el01sw-ib02 0a-eth-2
el01sw-ib02 0a-eth-3
. . .
root@el01cn16:~# dladm show-ib net5
LINK HCAGUID PORTGUID PORT STATE GWNAME GWPORT PKEYS
net5 2128000... 21280001EFF36A 2 up el01sw-ib02 0a-eth-1 7FFF,8206,FFFF
el01sw-ib02 0a-eth-2
el01sw-ib02 0a-eth-3
. . .
Make a note of the data that the command displays in the PORTGUID column for
both IB datalinks.
7. Run the commands iblinkinfo, ibswitches, and ibstat to determine the
mapping among the IB HCA ports, IB datalinks and IB switches. See the following
section of the first command output:
root@el01cn16:~# iblinkinfo|grep cn16
. . .
14 33[ ] ==(...)==> 72 2[ ] "el01cn16 EL-C 192.168.10.16 HCA-1" ( )
15 33[ ] ==(...)==> 71 1[ ] "el01cn16 EL-C 192.168.10.16 HCA-1" ( )
The output of the command displays a pair of value sets:
• switch lid 14, base lid 72, port 2
• switch lid 15, base lid 71, port 1
The following is an extract of the second command:
root@el01cn16:~# ibswitches
. . .
Switch : 0x0010e00b4520c0a0 ports 36 "SUN IB QDR GW switch el01sw-ib02
Set Up Ethernet Over InfiniBand (EoIB) on Oracle Solaris
Configure Ethernet Over InfiniBand 10-13
To Next Page
Loading...
Need help?
General
