Each PowerEdge MX7000 compute domain must connect to a pair of Dell EMC Networking S5232F-ON leaf switches to enable traffic flow to and from the compute sleds.
The Dell EMC S5232F-ON Switch connects directly to the first two chassis in each compute domain, using the MX9116n IOMs.
Dell EMC MX9116 Fabric Switching Engine IOM
On the MX9116n IOM, each of the first 12 external ports is of form factor QSFP28-DD, which provides two 100 GbE ports per socket, enabling a single connector to support 200 Gbps. In addition, the first 16 ports are internal ports, so faceplate numbering starts at port 17. The port layout consists of the following ports:
On each MX9116n IOM, four ports are used to connect to a pair of S5232F-ON switches. Two ports are connected to each S5232F-ON switch. In addition, four ports are used for an Interswitch Link (ISL) between the two MX9116n IOMs.
The MX9116n connection to the first S5232F-ON switch requires a breakout cable (2 x 100 Gbps) because the ports on the S5232F-ON switch are of the form factor QSFP28.
Ports 27–28 (QSFO28-DD) connect to QSFO28 ports on the first S5232F-ON switch and require a breakout cable. The following cables are supported:
Ports 37–40 (QSFO28-DD) connect to the same ports on the other MX8216n IOM and so breakout cables are not required. The following cables are supported:
Ports 41–42 (QSFO28-DD) connect to QSFO28 ports on the other S5232F-ON switch. The following cables are supported:
The following diagram shows the port connectivity.
Connections made from the MX7116n IOM to the MX9116n IOM are always in the same fabric. No connections are made between fabrics, ensuring the port configuration on each MX9116n is the same.
The following figure shows chassis connections that are positioned to provide a balanced airflow.
On the MX7116n IOM, only ports 1 through 2 are used and a single connection is made to an MX9116n IOM. Ports 3 through 4 are reserved for future use.
All port pairs are of form factor QSFP28-DD, which provides eight lanes at 25 Gbps each. By driving these channels at different speeds or combining channels, various Ethernet speeds can be achieved. In this case, the channels are used individually resulting in 8 x 25-GbE links. This enables each compute sled to have dedicated 25 GbE channels.
These ports connect to ports on another IOM, so breakout cables are not required. The following cables are supported:
The following figure shows domain connectivity for the MX9116n configuration (first two chassis only).
The following figure shows domain connectivity for chassis 3–10.