v Configure the network so that every node canister has at least two
connections to every node canister in a different control enclosure.
v You must configure the network before you attempt to add a control
enclosure to an existing system.
Configuration details for using RDMA-capable Ethernet ports for
node-to-node communications
Before you configure a system to use RDMA-capable Ethernet ports for
node-to-node communications, consider the following recommendations.
Use the following recommendations when you configure RDMA-capable Ethernet
ports for node-to-node communication:
v Assign different subnets for ports that are used for node-to-node communication
and port that are used for host attachment. For node-to-node communications
with RDMA-capable Ethernet ports, physical port identifiers of all the nodes in
the system must match and must be in the same subnet.
v Use dual, redundant switch configuration to avoid single point of failure in
Ethernet connectivity.
v Verify RDMA support on all switches before you configure RDMA-capable
Ethernet ports on nodes in the system.
v Ensure that round-trip time (RTT) is up to 80 milliseconds without any packet
drops.
v Use virtual LAN to create physical separation of networks for unrelated systems,
wherever possible. All the ports that are used for node-to node communication
must be assigned with one VLAN ID and ports that are used for host
attachment must have a different VLAN ID. If you plan to use VLAN to create
this separation, you must configure VLAN support on the all the Ethernet
switches in your network before you define the RDMA-capable Ethernet ports
on nodes in the system. On each switch in your network, set VLAN to Trunk
mode and specify the VLAN ID for the RDMA-ports that will be in the same
VLAN. In addition, if VLAN settings for a RDMA-capable Ethernet port needs
to be updated, these settings cannot be updated independently of other
configuration settings. Before you update VLAN settings on specific
RDMA-capable Ethernet ports, you must unconfigure the port, make any
necessary changes to the switch configuration, then reconfigure RDMA-capable
Ethernet ports on each of the nodes in the system.
v All systems that are not part of the current system that is being configured must
be physically separated from the Ethernet fabric. You can configure different
VLANs to achieve separation among systems.
v Verify the configuration on IP addresses on your network to ensure that there
are no duplicate IP addresses assigned.
v If you use firewalls in your network configuration, ensure that traffic is open for
TCP port 21455 and UDP ports 4791, 21451 and 21452. Node-to-node
communications with RDMA-capable Ethernet connections use TCP port 21455
for data traffic and UDP port 21451 and 21452 for service discovery on the
system. If you are using the RoCE protocol, ensure that traffic is also open for
UDP port. Additionally, RDMA-capable Ethernet ports use Internet Group
Management Protocol (IGMP) for group multicast communication for service
discovery, so ensure that IGMP traffic is enabled on the firewall for redundant
site configurations.
142 Storwize V7000 Gen2 and Gen2+: Quick Installation Guide
To Next Page
Loading...
