The following figure shows an example of a three-node cluster that is configured with a single-link full mesh storage network interconnect. External network traffic uses the LOM/rNDC/OCP integrated network adapter, while storage network traffic uses one RDMA-capable PCIe network adapter for each server node. The management network offers some redundancy in the event of a storage network connectivity (cable or port) failure.
This figure shows the three storage networks that are needed to create a single-link full mesh interconnect between three clustered nodes. The numbered blue lines indicate the recommended cabling order, beginning with the RDMA-capable PCIe network adapter in the lowest slot number, Port 1.
After cabling storage, connect all nodes, LOM/rNDC/OCP, and Ports 1 and 2 to a management/VM network.
Node | First port link connection | Second port link connection |
Node 1 | Storage1-2 | Storage1-3 |
Node 2 | Storage1-2 | Storage2-3 |
Node 3 | Storage1-3 | Storage2-3 |