Select a list that is preferably near the upper end of the 0x0001–0x7ffe range. For
example, if you identify 0x7000 to 0x7ffe as you range, you can create up to 4096
partitions. We recommend the upper end, because Exalogic Control assigns pkeys
starting from lower end—that is, 0x0001.
3. In this list (L2), mark or remove the pkeys that were assigned before the rack was
converted to a hybrid configuration—that is, the L1 list you created earlier.
4. As you create partitions, select pkeys from only the predetermined list (L2) and
keep track of the pkeys that you are assigning.
Such an approach provides a reasonable guarantee that pkeys assigned in the
physical environment are different from the pkeys that Exalogic Control assigns in
the virtual half of the rack.
After the Exalogic machine is converted to a hybrid rack, for every network (either
IPoIB or EoIB) that you create in the virtual half of the hybrid rack, Exalogic Control
automatically assigns a unique pkey, starting from 0x0001. While selecting an unused
pkey for a new partition, Exalogic Control will skip any pkeys (both L1 and L2) that
are used for partitions in the physical half of the configuration. This way, every
partition on the hybrid rack—regardless of whether it is on the physical or virtual part
—will have a unique pkey.
16.3 Before You Begin
Before you can start creating unique InfiniBand partitions, you must complete the
following tasks:
1. Verify the switch firmware version
2. Gather the port GUIDs of compute nodes and BridgeX ports of gateway switches
3. Identify the InfiniBand switches in your Exalogic machine's InfiniBand fabric and
note down their IP addresses
4. Determine which InfiniBand switch is running the master Subnet Manager (SM)
5. Log in to the InfiniBand switch that is running the master Subnet Manager (SM)
16.3.1 Verify the Firmware of InfiniBand Switch
Ensure that the InfiniBand switches in your Exalogic machine are installed with
firmware versions 2.0.4 or above. This requirement is mandatory.
16.3.2 Gather Port GUIDs of Compute Nodes and BridgeX Ports of Gateway Switches
Before creating an InfiniBand partition, you must identify the port GUIDs of Exalogic
compute nodes that will be added to the partition. In addition, you must identify the
BridgeX ports of the gateway switches that are connected to those Exalogic compute
nodes.
Identifying Port GUIDs on Compute Nodes
To identify the port GUIDs on an Exalogic compute node, run the following command
on the command line:
# ibstat
This command displays output, as in the following example:
Before You Begin
Use InfiniBand Partitions in Exalogic Physical Environments 16-3
To Next Page
Loading...
Need help?
General
