Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
End to end vSAN deployment with RDMA
Executive summary Introduction End-to-end configuration for vSAN with RDMA
Network configuration and setup
High Level Overview PCP + PFC + ECN configuration Example PCP + PFC configuration Example
PowerEdge server BIOS and NIC Firmware configurations
ESXi driver parameters
vSAN configuration
A vSAN with RDMA integration
Hardware/Software Details
Best Practices for vSAN with RDMA Conclusion Glossary References

Network configuration and setup

Home > Integrated Products > vSAN Ready Nodes > White Papers > End to end vSAN deployment with RDMA > Network configuration and setup

Network configuration and setup

  • High Level Overview

    Requirement: Login to your switch management with the admin credentials.

    1. Enter in CONFIGURATION mode.
    1. Enable the Data Center Bridging Exchange protocol (DCBX).
    2. Create a VLAN for vSAN.
    3. Apply the dot1p trust globally or at the interface level. In this example, the dot1p trust is applied globally.
    4. Create a network-qos type class-map and policy-map for priority flow control (PFC).

    Note: When you use the pause command without any parameters, the system uses the default buffer settings. Fine Tuning is unique to each environment.

    1. Create queuing-type class-maps and policy-map for enhanced transmission selection (ETS)
    2. Create a QoS map for ETS to map the lossy and lossless traffic to the respective queues.
    3. Perform the following configurations on all switch interfaces where you want to support RoCE
      1. Add VLAN for vSAN (except for VLTi interface)
      2. Enter INTERFACE mode and enter the no shutdown command.
      3. Change the switch port mode to trunk and specify the allowed VLANs on the trunk port.
      4. Apply the network-qos type policy-map to the interface.
      5. Apply the queuing policy to egress traffic on the interface.
      6. Enable ETS on the interface.
      7. Apply the qos-map for ETS configurations on the interface.
      8. Enable PFC on the interface.
    4. Exit CONFIGURATION mode & save the configuration

    Note: When a change is made to the switch running configuration, it’s required to flap the network interface from the switch (shut & no shut), Save switch configuration and do a host reboot to commit change.