Home > Integrated Products > VxBlock 1000 and 3-Tier Platform Reference Architectures > Guides > 3-Tier Platform Design Guide > Overview
This chapter describes the SAN network layer requirements and storage array components that are used in the 3-Tier Platform architecture.
Two Cisco MDS switches or directors provide connectivity between the compute layer and the storage layer.
Cisco UCS 4th and 5th generation FIs provide an FC port channel with one of the following connections:
The 32 Gbps connections require 32 Gbps SFPs and SAN ports. The Cisco MDS 9148T multilayer fabric switch supports eight connections from the Cisco UCS domain and up to two domains.
The Cisco MDS switches provide:
The Cisco MDS switches automatically negotiate the port speed based on the SFPs in the FIs. Front-end IOMs in the storage array connect to the Cisco MDS switches in the network layer over 32 Gbps FC links.
When incorporating any SAN switch into a 3-Tier Platform, consider airflow in the data center design. Some of the switches can be configured with either port-side intake or port-side exhaust airflow, while others can only be configured with port-side intake.
Table 39. Switch airflow configuration in 3-Tier Platforms
Switch | Airflow |
9148T | Port-side intake or port-side exhaust |
9396T | Port-side intake or port-side exhaust |
9706-v2 | Port side intake (front to back) |
9710-v2 | Port side intake (front to back) |
Note: ISLs to the external SAN or between switches are not permitted.
The following table describes Cisco MDS switches:
Table 40. Cisco MDS switches
Component | Description |
Cisco MDS 9148T multilayer fabric switch | 1U appliance that provides 24 to 48 line-rate ports for nonblocking, 32 Gbps throughput. The base license contains 24 ports per switch. Add pod licenses to increase the port count to 32, 40, or 48 per switch. |
Cisco MDS 9396T multilayer fabric switch | 2U appliance that provides 48 to 96 line-rate ports for nonblocking, 32 Gbps throughput. The base license contains 48 ports per switch. Add pod licenses to increase the port count in increments of 16. |
Cisco MDS 9706-v2 multilayer director | 9U appliance that provides up to 12 Tbps front panel FC line rate nonblocking, system-level switching. Consists of two 48-port line cards at line rate of 32 Gbps for all ports Add up to two 48-port line cards. Four Fabric 3 modules are required with all Cisco MDS 9706-V2 Multilayer Directors for an N+1 configuration and for full line rate support for all 32 Gbps line cards. Includes four PDUs and two supervisor modules |
Cisco MDS 9710-v2 multilayer director | 14U appliance that provides up to 24 Tbps front panel FC line rate nonblocking, system-level switching. Consists of two 48-port line cards at line rate of 32 Gbps for all ports Add up to six pairs of 48-port line cards. Four fabric-3 modules are included with all Cisco MDS 9710-V2 Multilayer Directors for an N+1 configuration and for full line rate support for all 32 Gbps line cards. Two additional power supplies are required with all Cisco MDS 9710-V2 Multilayer Directors. Includes six PDUs and two supervisor-4 modules. |
The Cisco MDS 9148T multilayer fabric switch provides 24 to 48 line-rate ports for nonblocking, 32 Gbps throughput. In the base configuration, 24 ports are licensed. More ports can be licensed as necessary in eight-port increments.
The following table shows core connectivity for the Cisco MDS 9148T multilayer fabric switch per fabric:
Table 41. Connectivity per fabric for the Cisco MDS 9148T multilayer fabric switch
Feature | Used ports | Port speeds | Media |
Cisco UCS 4th and 5th-generation FI uplinks | 4 or 8 per domain | 32 Gbps | SFP+ and optical cable |
Storage arrays | 2 - 40 | 32 Gbps | SFP+ and optical cable |
The base license includes 48 ports. More ports can be licensed in 16-port increments. The Cisco MDS 9396T 32G Multilayer Fabric Switch is a 96-port fixed switch with no IOM expansion slots.
The following table describes core connectivity for the Cisco MDS 9396T 32 G Multilayer Fabric Switch per fabric:
Table 42. Connectivity per fabric for the Cisco MDS 9396T 32 G Multilayer Fabric Switch
Feature | Ports used | Port speeds | Media |
Cisco UCS 4th and 5th-generation FI uplinks | 4 or 8 per domain | 32 Gbps | SFP+ and optical cable |
Storage arrays | 2 - 88 | 32 Gbps | SFP+ and optical cable |
Cisco MDS 9706-v2 and 9710-v2 multilayer directors are modular directors that provide greater scalability than the fixed SAN switches.
Both models deploy two supervisor modules for redundancy and three fabric modules for intradirector communication.
The Cisco MDS 9700 multilayer directors are director-class SAN switches with IOM expansion slots for 48-port 32 Gbps FC line cards. The Cisco MDS 9706-v2 switches and the Cisco MDS 9710-v2 multilayer directors have four and eight slots available for line cards, respectively. Each line card must be ordered in pairs per director and added in pairs to each director. Port licenses are not required for the 9700 multilayer directors.
Only four fabric-3 modules for each Cisco MDS 9706-v2 and 9710-v2 multilayer directors are required for N+1 redundancy and for full-line rate support for all 32 Gbps FC line cards.
The following table shows core connectivity per fabric for the Cisco MDS 9706-v2 and 9710-v2 multilayer directors:
Table 43. Core connectivity per fabric for Cisco MDS 9706-v2 and 9710-v2 multilayer directors
Feature | Ports used | Port speeds | Media |
Cisco UCS 4th-generation FI uplinks | 4 or 8 per domain | 32 Gbps | SFP+ and optical cable |
Cisco UCS 5th-generation FI uplinks | 4 or 8 per domain | 32 Gbps | 128G – 4x32G breakout |
Cisco MDS 9706-v2 | 2 to 184 | 32 Gbps | SFP+ and optical cable |
Cisco MDS 9710-v2 | 2 to 376 | 32 Gbps | SFP+ and optical cable |