Fibre Channel over Ethernet (FCoE) is used for storage I/O in PowerOne. Only Fabric A is used for FCoE. On Fabric A, the connection between the compute sleds and the MX9116n IOMs are configured for unified IO (network and storage I/O).
The MX9116n IOMs on Fabric A are directly connected to Connectrix SAN switches.
FC connections (Fabric A only)
The MX9116n IOMs support the following two interoperability modes for Fibre Channel storage:
PowerOne uses the NPG mode along with the core-edge, and this enables a better approach to maintain performance and availability as the system scales out.
A breakout cable is used to connect each port on MX9116n to four 32 Gb ports on the MDS edge. Eight ports are used on the MDS edge switch.
FC connection breakout
NPIV and oversubscription
N-Port ID Virtualization (NPIV) enables multiple N-ports to perform a Fabric Login (FLOGI) into a single F-port. Up to a maximum of 80 compute sleds can connect through these connections. Therefore, up to ten N-ports can be virtualized through each connection.
This feature simplifies the Fibre Channel cabling requirements and maximum F-port utilization. However, it adds an additional design consideration. Over subscription must be considered at each F-port and not just at the E-ports (ISL) now.
In PowerOne, a single compute domain can support up to eighty compute sleds. These compute sleds are connected to each SAN fabric through eight physical connections. Up to ten server blades can be connected to the storage through each physical connection. Each port on the 9396Tor 9148T switches supports up to ten virtual N-ports.
Storage connectivity and scale-out
In a PowerOne with a single Pod, the storage arrays can be connected to the 9396T or 9148T switches.
The 9396T switch provides ninety-six (96) 32-GB FC ports.
For more information about the 9396T switch, refer to the following link: