Introduction

The PowerSwitch S5248F-ON ToR switches support the database public and private interconnect traffic. They also support the database backup and recovery traffic by providing the interconnectivity between the database servers and the Data Domain backup appliance.

This section provides the recommended configuration of the S5248F-ON ToR switches to support the solution. Your environment might require additional configuration, including configuring the communication to the core data center network. For detailed configuration instructions, see the switch configuration guides at PowerSwitch S5248F-ON on Dell EMC Online Support.

Configuration steps

Configure the S5248F-ON ToR switches as follows, in accordance with recommended best practices.

Caution: Ensure that the personnel who are responsible for network management in your environment have reviewed the Spanning Tree Protocol (STP) configuration. Incorrect settings might cause network issues. The values that are provided here are examples only.

1. Configure the management IP address on each switch.

Note: The management IP address on the two switches is also used as the VLT backup link.

2. Enable Simple Network Management Protocol (SNMP):
   1. Configure Virtual Link Trunking (VLT) between the two S5248F-ON switches, using at least two of the 100 GbE link ports.

VLT provides a loop-free environment by presenting two physical switches as one logical switch while not losing bandwidth for the devices connecting to it over two separate links.

2. Enable Rapid Spanning Tree Protocol (RSTP) on the switches.

A default bridge priority value of 32768 or higher ensures that neither of the ToR switches becomes the root bridge when plugged in to the core data center network.

3. Enable the Spanning Tree Edge Port feature.
4. Create a port channel on both S5248F-ON switches by using the port that connects to the S4148T-ON management switch. Ensure that the port channel is configured as a VLT peer link aggregation group (LAG) on both switches.
5. Enable jumbo frames (MTU 9216) on the ports to be used for the database private interconnect traffic.
6. Configure the network traffic for the database public, backup and recovery, private interconnect, and private management on separate VLANs.

The following tables show an example of a VLAN configuration for the different traffic types:

Table 21.        Switch hostnames example

Table 22.        VLAN information example

* The VLAN IDs are examples. Network administrators can use VLAN IDs that conform to their network policies and standards if the database public and private networks are on two separate VLANs.

Table 23.        Customer network services example

Table 24.        Switch port-mapping example

Configure the S5248F-ON switches

Perform the following tasks on each of the S5248F-ON switches:

1. Using the RJ45-to-serial-port cable included with your switch, connect one end of the cable to your workstation and the other end to the RS-232 console port of the switch.

The following figure shows the console and management ports on the back of the switch. The console port is on the upper right near the fans and power supplies.

Figure 4.         Serial port

2. Using terminal emulation software, configure the COM port:

• 115200 baud rate
• No parity/no flow control
• 8 data bits/1 stop bit

3. When the connection is successful, enter configuration mode by running the following command:

OS10# configure terminal

4. Configure the hostname and time zone, and set a username and password for EXEC mode by running the following commands:

OS10(config)# hostname <hostname>

SW1(config)# username <username> password <password> role sysadmin

SW1(config)# clock timezone <timezone, for example, CST -6 0>

5. Configure routing to your default gateway, and save the configuration by running the following commands:

SW1(config)# ip route 0.0.0.0/0 <core network gateway>

SW1(config)# do write memory

Configure the management interface

The Virtual Link Trunking interconnect (VLTi) heartbeat uses the management interface on the back of the PowerSwitch S5248F-ON switch. Each S5248F-ON switch is connected to the S4148T-ON switch with a Cat 5e Ethernet network cable. To configure the management interface, enter configuration mode on each switch and follow these steps:

1. Configure the management port by running the following commands:

SW1(config)# interface mgmt 1/1

SW1(conf-if-ma-1/1/1)# no ip address dhcp

SW1(conf-if-ma-1/1/1)# ip address 172.90.100.252/24

SW2(conf-if-ma-1/1/1)# no ip address dhcp

SW2(conf-if-ma-1/1/1)# ip address 172.90.100.253/24

SW1(conf-if-ma-1/1/1)# exit

2. Enable STP by running the following commands.

Caution: Ensure that the personnel who are responsible for network management in your environment have reviewed the configuration for STP. Incorrect settings might cause network issues. The values that are provided here are examples only.

SW1(config)# spanning-tree mode rstp

SW1(config)# spanning-tree rstp priority 16384

SW2(config)# spanning-tree mode rstp

SW2(config)# spanning-tree rstp priority 32768

Configure the VLANs

This section describes how to configure the VLANs on the S5248F-ON switches. The examples show how to configure each VLAN in the site survey. Server NIC ports 1 and 2 are used for all traffic. If your configuration does not use spine/leaf network architecture or if you do not want VLAN traffic to be routed by the S5248F-ON switches, skip the commands in bold italics.

Follow these steps on each S5248-ON switch:

1. Configure the OOB VLAN:

SW1(config)# interface vlan 100

SW1(conf-if-vl-100)# description “Out-Of-Band VLAN”

SW1(conf-if-vl-100)# ip address 172.90.100.252/24

SW1(conf-if-vl-100)# mtu 9000

SW1(conf-if-vl-100)# vrrp-group 1

SW1(conf-if-vlan100-vrid-1)# virtual-address 172.90.100.254

SW1(conf-if-vlan100-vrid-1)# exit

SW1(conf-if-vl-100)# no shutdown

SW1(conf-if-vl-100)# exit

SW1(config)# do write

2. Configure the management VLAN:

SW1(config)# interface vlan 110

SW1(conf-if-vl-110)# description “Management VLAN”

SW1(conf-if-vl-110)# ip address 172.90.110.252/24

SW1(conf-if-vl-110)# mtu 9000

SW1(conf-if-vl-110)# vrrp-group 2

SW1(conf-if-vlan110-vrid-2)# virtual-address 172.90.110.254

SW1(conf-if-vlan110-vrid-2)# exit

SW1(conf-if-vl-110)# no shutdown

SW1(conf-if-vl-110)# exit

SW1(config)# do write

3. Configure the VM migration VLAN:

SW1(config)# interface vlan 120

SW1(conf-if-vl-120)# description “VM migration VLAN”

SW1(conf-if-vl-120)# ip address 172.90.120.252/24

SW1(conf-if-vl-120)# mtu 9000

SW1(conf-if-vl-120)# vrrp-group 3

SW1(conf-if-vlan120-vrid-3)# virtual-address 172.90.120.254

SW1(conf-if-vlan120-vrid-3)# exit

SW1(conf-if-vl-120)# no shutdown

SW1(conf-if-vl-120)# exit

SW1(config)# do write

4. Configure the DB Private VLAN:

SW1(config)# interface vlan 130

SW1(conf-if-vl-130)# description “DB Private VLAN”

SW1(conf-if-vl-130)# ip address 172.90.130.252/24

SW1(conf-if-vl-130)# mtu 9000

SW1(conf-if-vl-130)# vrrp-group 4

SW1(conf-if-vlan130-vrid-4)# virtual-address 172.90.130.254

SW1(conf-if-vlan130-vrid-4)# exit

SW1(conf-if-vl-130)# no shutdown

SW1(conf-if-vl-130)# exit

SW1(config)# do write

5. Configure the DB Public VLAN:

SW1(config)# interface vlan 140

SW1(conf-if-vl-140)# description “DB Public VLAN”

SW1(conf-if-vl-140)# ip address 172.90.140.252/24

SW1(conf-if-vl-140)# mtu 9000

SW1(conf-if-vl-140)# vrrp-group 5

SW1(conf-if-vlan140-vrid-5)# virtual-address 172.90.140.254

SW1(conf-if-vlan140-vrid-5)# exit

SW1(conf-if-vl-140)# no shutdown

SW1(conf-if-vl-140)# exit

SW1(config)# do write

6. To verify that all the settings have been recorded, review the configuration from enable mode by running the following command:

SW1# show running-config

7. Repeat the preceding steps to configure the bottom S5248F-ON switch in the configuration.

Configure the VLTi ports

On each switch, configure the ports to be used for VLTi traffic as follows:

1. Run the following commands:

SW1(config)# interface range ethernet 1/1/53-1/1/54

SW1(conf-range-eth1/1/53-1/1/54)# description VLTi

SW1(conf-range-eth1/1/53-1/1/54)# no switchport

SW1(conf-range-eth1/1/53-1/1/54)# exit

2. Create the VLT domain and add the discovery interfaces:

SW1(config)# vlt-domain 1

SW1(conf-vlt-1)# backup destination 192.168.1.253

SW2(conf-vlt-1)# backup destination 192.168.1.252

SW1(conf-vlt-1)# discovery-interface ethernet 1/1/53-1/1/54

SW1(conf-vlt-1)# do write memory

3. Ensure that the VLT domain is properly configured by running the following command in enable mode:

SW1# show vlt 1 | find Status

The following output is displayed:

VLTi Link Status

    port-channel1000       : up

VLT Peer

Unit ID  System MAC Address  Status  IP Address    Version

------------------------------------------------------------

1        54:bf:64:be:f7:40   up      192.168.1.253  2.0

4. Run the following commands to configure the ports that the servers are connected to on the switch.

In this example, ports Ethernet 1/1/1 through Ethernet 1/1/16 are in use on each switch.

SW1(config)# interface range ethernet 1/1/1-1/1/16

SW1(conf-range-eth1/1/1-1/1/16)# no ip address

SW1(conf-range-eth1/1/1-1/1/16)# mtu 9000

SW1(conf-range-eth1/1/1-1/1/16)# switchport mode trunk

SW1(conf-range-eth1/1/1-1/1/16)# switchport access vlan 100

SW1(conf-range-eth1/1/1-1/1/16)# switchport trunk allowed vlan 110,120,130,140

SW1(conf-range-eth1/1/1-1/1/16)# spanning-tree port type edge

SW1(conf-range-eth1/1/1-1/1/16)# spanning-tree guard root

SW1(conf-range-eth1/1/1-1/1/16)# no shutdown

5. Verify that the ports are configured correctly by running the following command:

SW1(conf-range-eth1/1/1-1/1/16)# show config

The output for each port is as follows:

interface ethernet1/1/1

 no shutdown

 switchport mode trunk

 switchport access vlan 100

 switchport trunk allowed vlan 110,120,130,140[1]

 mtu 9000

 flowcontrol receive off

 spanning-tree guard root

 spanning-tree port type edge

!

…

Configure the port channel

The S4148T-ON switch connects to the network through the S5248F-ON switches using a port channel consisting of one interface on each S5248F‑ON switch. On each switch, configure the port channel and port as follows:

1. Configure the port channel by running the following commands:

SW1(config)# interface port-channel 101

SW1(conf-if-po-101)# description “OOB uplink”

SW1(conf-if-po-101)# no shutdown

SW1(conf-if-po-101)# switchport mode trunk

SW1(conf-if-po-101)# switchport trunk allowed vlan 100,110,120,130,140

SW1(conf-if-po-101)# mtu 9000

SW1(conf-if-po-101)# vlt-port-channel 101

SW1(conf-if-po-101)# exit

2. Configure the port that will be used for the port channel by running the following commands:

SW1(config)# port-group 1/1/12

SW1(conf-pg-1/1/12)# mode Eth 10g-4x

SW1(conf-pg-1/1/12)# exit

SW1(config)# interface ethernet 1/1/48:1

SW1(conf-if-eth1/1/48:1)# no shutdown

SW1(conf-if-eth1/1/48:1)# description “OOB uplink”

SW1(conf-if-eth1/1/48:1)# channel-group 101 mode active

SW1(conf-if-eth1/1/48:1)# mtu 9000

SW1(conf-if-eth1/1/48:1)# exit