Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
VMware Cloud Foundation on VxRail Multirack Deployment Using BGP EVPN - Part 2 of 2
Introduction Hardware Overview Network Transport Topology Planning and Preparation Configure and Verify the Underlay Network
Configure leaf switch underlay networking
Configure leaf switch NSX-T overlay networking
Configure spine switches
Verify establishment of BGP between leaf and spine switches
Verify BGP EVPN and VXLAN between leaf switches
Create a VxRail Virtual Infrastructure Workload Domain Configure NSX-T North-South Connectivity Validate Connectivity Between Virtual Machines Validated Components Technical Resources Fabric Design Center Support and Feedback Attachments

Configure spine switches

Home > Networking Solutions > Converged and Hyperconverged Solutions > VxRail Networking Solutions > Guides > VMware Cloud Foundation on VxRail Multirack Deployment Using BGP EVPN - Part 2 of 2 > Configure spine switches

Configure spine switches

  • This section covers the configuration of the Z9264-ON switch with the hostname sfo01-spine01 that is shown in Figure 19.

    Note: All switch configuration commands are provided in the file attachments. See Attachments for instructions on accessing the attachments.

    Figure 19.     Spine layer diagram

    Note: Some of the steps in this section may already be done if all configuration steps from the VCF on VxRail Multirack Deployment using BGP EVPN: Creating a management domain with NSX-V (part 1 of 2) deployment guide were followed. All steps are included here to ensure completion.

    1. Configure general switch settings, including OOB management and NTP source.

    OS10# configure terminal

    OS10(config)# interface mgmt 1/1/1

    OS10(conf-if-ma-1/1/1)# no ip address dhcp

    OS10(conf-if-ma-1/1/1)# ip address 100.67.198.36/24

    OS10(conf-if-ma-1/1/1)# exit

    OS10(config)# management route 100.67.0.0/16 managementethernet

    OS10(config)# hostname sfo01-Spine01

    sfo01-Spine01(config)# ntp server 100.67.10.20

    sfo01-Spine01(config)# hardware forwarding-table mode scaled-l3-routes

    sfo01-Spine01(config)# bfd enable

    1. Configure a loopback interface for the Router ID.

    sfo01-Spine01(config)# interface loopback 0

    sfo01-Spine01(conf-if-lo-0)# description Router-ID

    sfo01-Spine01(conf-if-lo-0)# no shutdown

    sfo01-Spine01(conf-if-lo-0)# ip address 10.0.1.1/32

    sfo01-Spine01(conf-if-lo-0)# exit

    1. Using the following commands, configure downstream ports on underlay links to leaf switches.

    sfo01-Spine01(config)# interface ethernet1/1/11

    sfo01-Spine01(conf-if-eth1/1/11)# description sfo01-Leaf01A

    sfo01-Spine01(conf-if-eth1/1/11)# no shutdown

    sfo01-Spine01(conf-if-eth1/1/11)# no switchport

    sfo01-Spine01(conf-if-eth1/1/11)# mtu 9216

    sfo01-Spine01(conf-if-eth1/1/11)# ip address 192.168.1.0/31

    sfo01-Spine01(conf-if-eth1/1/11)# exit

    sfo01-Spine01(config)# interface ethernet1/1/12

    sfo01-Spine01(conf-if-eth1/1/12)# description sfo01-Leaf01B

    sfo01-Spine01(conf-if-eth1/1/12)# no shutdown

    sfo01-Spine01(conf-if-eth1/1/12)# no switchport

    sfo01-Spine01(conf-if-eth1/1/12)# mtu 9216

    sfo01-Spine01(conf-if-eth1/1/12)# ip address 192.168.1.2/31

    sfo01-Spine01(conf-if-eth1/1/12)# exit

    sfo01-Spine01(config)# interface ethernet1/1/13

    sfo01-Spine01(conf-if-eth1/1/13)# description sfo01-Leaf02A

    sfo01-Spine01(conf-if-eth1/1/13)# no shutdown

    sfo01-Spine01(conf-if-eth1/1/13)# no switchport

    sfo01-Spine01(conf-if-eth1/1/13)# mtu 9216

    sfo01-Spine01(conf-if-eth1/1/13)# ip address 192.168.1.4/31

    sfo01-Spine01(conf-if-eth1/1/13)# exit

    sfo01-Spine01(config)# interface ethernet1/1/14

    sfo01-Spine01(conf-if-eth1/1/14)# description sfo01-Leaf02B

    sfo01-Spine01(conf-if-eth1/1/14)# no shutdown

    sfo01-Spine01(conf-if-eth1/1/14)# no switchport

    sfo01-Spine01(conf-if-eth1/1/14)# mtu 9216

    sfo01-Spine01(conf-if-eth1/1/14)# ip address 192.168.1.6/31

    sfo01-Spine01(conf-if-eth1/1/14)# exit

    1. Add a route map using the following commands:

    sfo01-Spine01(config)# ip prefix-list spine-leaf seq 10 permit 10.0.1.0/24 ge 32

    sfo01-Spine01(config)# ip prefix-list spine-leaf seq 20 permit 10.2.1.0/24 ge 32

    sfo01-Spine01(config)# route-map spine-leaf permit 10

    sfo01-Spine01(config-route-map)# match ip address prefix-list spine-leaf

    sfo01-Spine01(config-route-map)# exit

    1. Enter the following commands to configure eBGP.

    sfo01-Spine01(config)# router bgp 65100

    sfo01-Spine01(config-router-bgp-65100)# bfd all-neighbors interval 200 min_rx 200 multiplier 3 role active

    sfo01-Spine01(config-router-bgp-65100)# router-id 10.0.1.1

    sfo01-Spine01(config-router-bgp-65100)# address-family ipv4 unicast

    sfo01-Spine01(config-router-bgpv4-af)# redistribute connected route-map spine-leaf

    sfo01-Spine01(config-router-bgp-65100)# bestpath as-path multipath-relax

    sfo01-Spine01(config-router-bgp-65100)# maximum-paths ebgp 2

    sfo01-Spine01(config-router-bgpv4-af)# exit

    1. Configure eBGP for IPv4 point-to-point peering.

    sfo01-Spine01(config-router-bgp-65100)# neighbor 192.168.1.1

    sfo01-Spine01(config-router-neighbor)# remote-as 65101

    sfo01-Spine01(config-router-neighbor)# no shutdown

    sfo01-Spine01(config-router-neighbor)# advertisement-interval 5

    sfo01-Spine01(config-router-neighbor)# bfd

    sfo01-Spine01(config-router-neighbor)# fall-over

    sfo01-Spine01(config-router-neighbor)# exit

    sfo01-Spine01(config-router-bgp-65100)# neighbor 192.168.1.3

    sfo01-Spine01(config-router-neighbor)# remote-as 65101

    sfo01-Spine01(config-router-neighbor)# no shutdown

    sfo01-Spine01(config-router-neighbor)# advertisement-interval 5

    sfo01-Spine01(config-router-neighbor)# bfd

    sfo01-Spine01(config-router-neighbor)# fall-over

    sfo01-Spine01(config-router-neighbor)# exit

    sfo01-Spine01(config-router-bgp-65100)# neighbor 192.168.1.5

    sfo01-Spine01(config-router-neighbor)# remote-as 65102

    sfo01-Spine01(config-router-neighbor)# no shutdown

    sfo01-Spine01(config-router-neighbor)# advertisement-interval 5

    sfo01-Spine01(config-router-neighbor)# bfd

    sfo01-Spine01(config-router-neighbor)# fall-over

    sfo01-Spine01(config-router-neighbor)# exit

    sfo01-Spine01(config-router-bgp-65100)# neighbor 192.168.1.7

    sfo01-Spine01(config-router-neighbor)# remote-as 65102

    sfo01-Spine01(config-router-neighbor)# no shutdown

    sfo01-Spine01(config-router-neighbor)# advertisement-interval 5

    sfo01-Spine01(config-router-neighbor)# bfd

    sfo01-Spine01(config-router-neighbor)# fall-over

    sfo01-Spine01(config-router-neighbor)# exit

    sfo01-Spine01(config-router-bgp-65100)# exit

    1. Configure a loopback interface for BGP EVPN peering.

    sfo01-Spine01(config)# interface loopback 1

    sfo01-Spine01(conf-if-lo-1)# description evpn_loopback

    sfo01-Spine01(conf-if-lo-1)# no shutdown

    sfo01-Spine01(conf-if-lo-1)# ip address 10.2.1.1/32

    sfo01-Spine01(conf-if-lo-1)# exit

    1. Configure BGP EVPN peering.

    sfo01-Spine01(config)# router bgp 65100

    sfo01-Spine01(config-router-bgp-65100)# neighbor 10.2.2.1

    sfo01-Spine01(config-router-neighbor)# remote-as 65101

    sfo01-Spine01(config-router-neighbor)# send-community extended

    sfo01-Spine01(config-router-neighbor)# update-source loopback1

    sfo01-Spine01(config-router-neighbor)# ebgp-multihop 2

    sfo01-Spine01(config-router-neighbor)# no shutdown

    sfo01-Spine01(config-router-neighbor)# address-family ipv4 unicast

    sfo01-Spine01(config-router-neighbor-af)# no activate

    sfo01-Spine01(config-router-neighbor-af)# exit

    sfo01-Spine01(config-router-neighbor)# address-family l2vpn evpn

    sfo01-Spine01(config-router-neighbor-af)# activate

    sfo01-Spine01(config-router-neighbor-af)# exit

    sfo01-Spine01(config-router-neighbor)# exit

    sfo01-Spine01(config-router-bgp-65100)# neighbor 10.2.2.2

    sfo01-Spine01(config-router-neighbor)# remote-as 65101

    sfo01-Spine01(config-router-neighbor)# send-community extended

    sfo01-Spine01(config-router-neighbor)# update-source loopback1

    sfo01-Spine01(config-router-neighbor)# ebgp-multihop 2

    sfo01-Spine01(config-router-neighbor)# no shutdown

    sfo01-Spine01(config-router-neighbor)# address-family ipv4 unicast

    sfo01-Spine01(config-router-neighbor-af)# no activate

    sfo01-Spine01(config-router-neighbor-af)# exit

    sfo01-Spine01(config-router-neighbor)# address-family l2vpn evpn

    sfo01-Spine01(config-router-neighbor-af)# activate

    sfo01-Spine01(config-router-neighbor-af)# exit

    sfo01-Spine01(config-router-neighbor)# exit

    sfo01-Spine01(config-router-bgp-65100)# neighbor 10.2.2.3

    sfo01-Spine01(config-router-neighbor)# remote-as 65102

    sfo01-Spine01(config-router-neighbor)# send-community extended

    sfo01-Spine01(config-router-neighbor)# update-source loopback1

    sfo01-Spine01(config-router-neighbor)# ebgp-multihop 2

    sfo01-Spine01(config-router-neighbor)# no shutdown

    sfo01-Spine01(config-router-neighbor)# address-family ipv4 unicast

    sfo01-Spine01(config-router-neighbor-af)# no activate

    sfo01-Spine01(config-router-neighbor-af)# exit

    sfo01-Spine01(config-router-neighbor)# address-family l2vpn evpn

    sfo01-Spine01(config-router-neighbor-af)# activate

    sfo01-Spine01(config-router-neighbor-af)# exit

    sfo01-Spine01(config-router-neighbor)# exit

    sfo01-Spine01(config-router-bgp-65100)# neighbor 10.2.2.4

    sfo01-Spine01(config-router-neighbor)# remote-as 65102

    sfo01-Spine01(config-router-neighbor)# send-community extended

    sfo01-Spine01(config-router-neighbor)# update-source loopback1

    sfo01-Spine01(config-router-neighbor)# ebgp-multihop 2

    sfo01-Spine01(config-router-neighbor)# no shutdown

    sfo01-Spine01(config-router-neighbor)# address-family ipv4 unicast

    sfo01-Spine01(config-router-neighbor-af)# no activate

    sfo01-Spine01(config-router-neighbor-af)# exit

    sfo01-Spine01(config-router-neighbor)# address-family l2vpn evpn

    sfo01-Spine01(config-router-neighbor-af)# activate

    sfo01-Spine01(config-router-neighbor-af)# exit

    sfo01-Spine01(config-router-neighbor)# exit

    sfo01-Spine01(config-router-bgp-65100)# exit

    1. Repeat the steps using the appropriate values from Switch settings for the remaining spine switch.