Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Tech Book—Dell Integrated System for Microsoft Azure Stack Hub
Executive summary Solution Overview Prerequisites Hardware Infrastructure Networking and Cabling
Networking and Cabling
Networking
Scale unit node network connectivity
Border connectivity
Dense configuration networking
Hybrid configuration networking
All-flash configuration networking
Azure Stack Hub switch cabling
Border Gateway Protocol routing
Static routing
Transparent proxy
Firewall integration
Deployment
Operations and Management Software Security Maintaining the Solution Backup and Recovery Conclusion License Retrieval Dell Technologies Support and Consulting Offerings

Azure Stack Hub switch cabling

Azure Stack Hub switch cabling

  • The following tables list the port maps for the baseboard management controller (BMC) switch, also called the management switch, and the top-of-rack (ToR) switches.


    Server and switch port description references

    This list defines the server and switch port connections that are listed in the tables in the following sections.

    • GMTP—Management ports on ToR switch (PowerSwitch S5248F-ON)
    • BMC—Management switch (PowerSwitch N3248TE-ON)
    • HLH—Hardware life cycle host (PowerEdge R640)
    • OoB—Connects to iDRAC management ports
    • rNDC1—Left port on Mellanox Connectx-4
    • rNDC2—Right port on Mellanox Connectx-4
    • HLH-rNDC1—Left port on Intel NDC card

    N3248TE-ON BMC port map

    The following table lists the connection and cable types, node ports, and switch ports for the N3248TE-ON BMC switch for the hybrid, all-flash, and dense configurations.

    Table 29. N3248TE-ON BMC connection and cable types, node ports, and switch ports
    Connection and cable type From originating port To BMC switch port
    1 Gb Cat 6 Node 01 OoB NIC (iDRAC) Port 01
    1 Gb Cat 6 Node 02 OoB NIC (iDRAC) Port 02
    1 Gb Cat 6 Node 03 OoB NIC (iDRAC) Port 03
    1 Gb Cat 6 Node 04 OoB NIC (iDRAC) Port 04
    1 Gb Cat 6 Node 05 OoB NIC (iDRAC) Port 05
    1 Gb Cat 6 Node 06 OoB NIC (iDRAC) Port 06
    1 Gb Cat 6 Node 07 OoB NIC (iDRAC) Port 07
    1 Gb Cat 6 Node 08 OoB NIC (iDRAC) Port 08
    1 Gb Cat 6 Node 09 OoB NIC (iDRAC) Port 09
    1 Gb Cat 6 Node 10 OoB NIC (iDRAC) Port 10
    1 Gb Cat 6 Node 11 OoB NIC (iDRAC) Port 11
    1 Gb Cat 6 Node 12 OoB NIC (iDRAC) Port 12
    1 Gb Cat 6 Node 13 OoB NIC (iDRAC) Port 13
    1 Gb Cat 6 Node 14 OoB NIC (iDRAC) Port 14
    1 Gb Cat 6 Node 15 OoB NIC (iDRAC) Port 15
    1 Gb Cat 6 Node 16 OoB NIC (iDRAC) Port 16
    1 Gb Cat 6 BMC reserved PDU Port 41
    1 Gb Cat 6 BMC reserved PDU Port 42
    1 Gb Cat 6 BMC reserved PDU Port 43
    1 Gb Cat 6 BMC reserved PDU Port 44
    1 Gb Cat 6

    Hardware Lifecycle Host OoB

    NIC (iDRAC)

    		Port 46
    1 Gb Cat 6 ToR 1 switch management port Port 47
    1 Gb Cat 6 ToR 2 switch management port Port 48
    10 Gb SFP28-Twinaxial

    Hardware Lifecycle Host 10

    GbE port 1 (PCI1-1)

    		Port 49
    10 Gb SFP28-Twinaxial

    Hardware Lifecycle Host 10

    GbE port 2 (PCI1-2)

    		Port 50
    10 Gb SFP28-Twinaxial S5248F-ON ToR 1 switch port 44 Port 51
    10 Gb SFP28-Twinaxial S5248F-ON ToR 2 switch port 44 Port 52

    S5248F-ON ToR 1 port map

    The following table lists the connection and cable types, node ports, and switch ports for the S5248F-ON ToR 1 switch for the hybrid, all-flash, and dense configurations.

    Table 30. S5248F-ON ToR 1 connection and cable types, node ports, and switch ports
    Connection and cable type From originating port To ToR 1 switch port
    25 Gb Twinaxial Node 01 NIC port 1 (rNDC1-1) Port 01
    25 Gb Twinaxial Node 02 NIC port 1 (rNDC1-1) Port 02
    25 Gb Twinaxial Node 03 NIC port 1 (rNDC1-1) Port 03
    25 Gb Twinaxial Node 04 NIC port 1 (rNDC1-1) Port 04
    25 Gb Twinaxial Node 05 NIC port 1 (rNDC1-1) Port 05
    25 Gb Twinaxial Node 06 NIC port 1 (rNDC1-1) Port 06
    25 Gb Twinaxial Node 07 NIC port 1 (rNDC1-1) Port 07
    25 Gb Twinaxial Node 08 NIC port 1 (rNDC1-1) Port 08
    25 Gb Twinaxial Node 09 NIC port 1 (rNDC1-1) Port 09
    25 Gb Twinaxial Node 10 NIC port 1 (rNDC1-1) Port 10
    25 Gb Twinaxial Node 11 NIC port 1 (rNDC1-1) Port 11
    25 Gb Twinaxial Node 12 NIC port 1 (rNDC1-1) Port 12
    25 Gb Twinaxial Node 13 NIC port 1 (rNDC1-1) Port 13
    25 Gb Twinaxial Node 14 NIC port 1 (rNDC1-1) Port 14
    25 Gb Twinaxial Node 15 NIC port 1 (rNDC1-1) Port 15
    25 Gb Twinaxial Node 16 NIC port 1 (rNDC1-1) Port 16
    25 Gb Twinaxial ToR 2 switch port 39 (BGP) Port 39
    25 Gb Twinaxial ToR 2 switch port 40 (BGP) Port 40
    10 Gb Twinaxial BMC switch port 51 Port 44
    25 Gb Fiber

    Customer border switch 4

    (optional)

    		Port 45
    25 Gb Fiber

    Customer border switch 3

    (optional)

    		Port 46
    25 Gb Fiber Customer border switch 2 Port 47
    25 Gb Fiber Customer border switch 1 Port 48
    200 Gb Twinaxial ToR2 VLTi peer link Port 49/50
    200 Gb Twinaxial ToR2 VLTi peer link Port 51/52
    Note: Ports 49/50 and 50/51 on the S5248F-ON use a single jack that can be configured with either a single density QSFP for 100 Gb connectivity or a double density QSFP for 200 Gb connectivity.

    The standard shipping configuration is to have QSFP-DD cables running between the two ToRs for 200 GB connectivity. On the switches, the differences between using the 100 Gb single-density cables and the 200 Gb double-density cables is shown in the following tables.

    Table 31. Single-density cables - 100 GB
    Port Status Speed Duplex
    Eth 1/1/49 Up 100 Gb Full
    Eth 1/1/50 Down 0 Full
    Eth 1/1/51 Up 100 Gb Full
    Eth 1/1/52 Down 0 Full
    Table 32. Double-density cables - 200 GB
    Port Status Speed Duplex
    Eth 1/1/49 Up 100 Gb Full
    Eth 1/1/50 Up 100 Gb Full
    Eth 1/1/51 Up 100 Gb Full
    Eth 1/1/52 Up 100 Gb Full

    S5248F-ON ToR 2 port map

    The following table lists the connection and cable types, node ports, and switch ports for the S5248F-ON ToR 2 switch for the hybrid, all-flash, and dense configurations.

    Table 33. S5248F-ON ToR 2 connection and cable types, node ports, and switch ports
    Connection and cable type From originating port To switch port
    25 Gb Twinaxial Node 01 NIC port 2 (rNDC2-2) Port 01
    25 Gb Twinaxial Node 02 NIC port 2 (rNDC2-2) Port 02
    25 Gb Twinaxial Node 03 NIC port 2 (rNDC2-2) Port 03
    25 Gb Twinaxial Node 04 NIC port 2 (rNDC2-2) Port 04
    25 Gb Twinaxial Node 05 NIC port 2 (rNDC2-2) Port 05
    25 Gb Twinaxial Node 06 NIC port 2 (rNDC2-2) Port 06
    25 Gb Twinaxial Node 07 NIC port 2 (rNDC2-2) Port 07
    25 Gb Twinaxial Node 08 NIC port 2 (rNDC2-2) Port 08
    25 Gb Twinaxial Node 09 NIC port 2 (rNDC2-2) Port 09
    25 Gb Twinaxial Node 10 NIC port 2 (rNDC2-2) Port 10
    25 Gb Twinaxial Node 11 NIC port 2 (rNDC2-2) Port 11
    25 Gb Twinaxial Node 12 NIC port 2 (rNDC2-2) Port 12
    25 Gb Twinaxial Node 13 NIC port 2 (rNDC2-2) Port 13
    25 Gb Twinaxial Node 14 NIC port 2 (rNDC2-2) Port 14
    25 Gb Twinaxial Node 15 NIC port 2 (rNDC2-2) Port 15
    25 Gb Twinaxial Node 16 NIC port 2 (rNDC2-2) Port 16
    25 Gb Twinaxial ToR 1 port 39 (BGP) Port 39
    25 Gb Twinaxial ToR 1 port 40 (BGP) Port 40
    10 Gb Twinaxial BMC port 52 Port 44
    25 Gb Fiber

    Customer border switch 4

    (optional)

    		Port 45
    25 Gb Fiber

    Customer border switch 3

    (optional)

    		Port 46
    25 Gb Fiber Customer border switch 2 Port 47
    25 Gb Fiber Customer border switch 1 Port 48
    200 Gb Twinaxial ToR 1 VLTi peer link Port 49/50
    200 Gb Twinaxial ToR 1 VLTi peer link Port 51/52
    Note: Ports 49/50 and 50/51 on the S5248F-ON use a single jack that can be configured with either a single density QSFP for 100 Gb connectivity or a double density QSFP for 200 Gb connectivity.

    The standard shipping configuration is to have QSFP-DD cables running between the two ToRs for 200 GB connectivity. On the switches, the differences between using the 100 Gb single-density cables and the 200 Gb double-density cables is shown in the following tables.

    Table 34. Single-density cables - 100 Gb
    Port Status Speed Duplex
    Eth 1/1/49 Up 100 Gb Full
    Eth 1/1/50 Down 0 Full
    Eth 1/1/51 Up 100 Gb Full
    Eth 1/1/52 Down 0 Full
    Table 35. Double-density cables - 200 Gb
    Port Status Speed Duplex
    Eth 1/1/49 Up 100 Gb Full
    Eth 1/1/50 Up 100 Gb Full
    Eth 1/1/51 Up 100 Gb Full
    Eth 1/1/52 Up 100 Gb Full

    The following table lists Cisco cable placement and port mapping.

    Note: Cisco switch is only available with the customer-rack option. For details, see Rail kit information.

    Table 36. Cisco cable placement and port mapping
    Cisco C93180YC-FX Cisco 9348GC-FXP
    Cable type Originating port ToR-1 switch port Originating port ToR-2 switch port Cable type Originating port BMC switch port
    25 GB Twinax Node-01 – rNDC1-1 Port-01 Node-01 – rNDC2-2 Port-01 1 GB CAT6 Node-01– iDRAC Port-01
    Node-02 – rNDC1-1 Port-02 Node-02 – rNDC2-2 Port-02 Node-02– iDRAC Port-02
    Node-03 – rNDC1-1 Port-03 Node-03 – rNDC2-2 Port-03 Node-03– iDRAC Port-03
    Node-04 – rNDC1-1 Port-04 Node-04 – rNDC2-2 Port-04 Node-04– iDRAC Port-04
    Node-05 – rNDC1-1 Port-05 Node-05 – rNDC2-2 Port-05 Node-05– iDRAC Port-05
    Node-06 – rNDC1-1 Port-06 Node-06 – rNDC2-2 Port-06 Node-06– iDRAC Port-06
    Node-07 – rNDC1-1 Port-07 Node-07 – rNDC2-2 Port-07 Node-07– iDRAC Port-07
    Node-08 – rNDC1-1 Port-08 Node-08 – rNDC2-2 Port-08 Node-08– iDRAC Port-08
    Node-09 – rNDC1-1 Port-09 Node-09 – rNDC2-2 Port-09 Node-09– iDRAC Port-09
    Node-10 – rNDC1-1 Port-10 Node-10 – rNDC2-2 Port-10 Node-10– iDRAC Port-10
    Node-11 – rNDC1-1 Port-11 Node-11 – rNDC2-2 Port-11 Node-11– iDRAC Port-11
    Node-12 – rNDC1-1 Port-12 Node-12 – rNDC2-2 Port-12 Node-12– iDRAC Port-12
    Node-13 – rNDC1-1 Port-13 Node-13 – rNDC2-2 Port-13 Node-13– iDRAC Port-13
    Node-14 – rNDC1-1 Port-14 Node-14 – rNDC2-2 Port-14 Node-14– iDRAC Port-14
    Node-15 – rNDC1-1 Port-15 Node-15 – rNDC2-2 Port-15 Node-15– iDRAC Port-15
    Node-16 – rNDC1-1 Port-16 Node-16 – rNDC2-2 Port-16 Node-16– iDRAC Port-16

    ToR-2

    Switch Port-39

    		Port-39

    ToR-1

    Switch Port-39

    		Port-39 HLH-iDRAC Port-46

    ToR-2

    Switch Port-40

    		Port-40

    ToR-1

    Switch Port-40

    		Port-40 ToR-1 Switch MGMT Port-47
    BMC Switch Port-51 Port-44 BMC Switch Port-52 Port-44 ToR-2 Switch MGMT Port-48
    10/25 GB Fiber

    Customer Border-4

    (optional)

    		Port-45

    Customer Border-4

    (optional)

    		Port-45 10/25 GbE Twinax HLH-PCI1-1 Port-49

    Customer Border-3

    (optional)

    		Port-46

    Customer Border-3

    (optional)

    		Port-46 HLH-PCI1-2 Port-50
    Customer Border-2 Port-47 Customer Border-2 Port-47 25 GbE Twinax ToR-1 Port-44 Port-51
    Customer Border-1 Port-48 Customer Border-1 Port-48 ToR-2 Port-44 Port-52
    40/100 GB Twinax ToR-2 Port-49 Port-49 ToR-1 Port-49 Port-49
    ToR-2 Port-50 Port-50 ToR-1 Port-50 Port-50