Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
End to end vSAN deployment with RDMA
Executive summary Introduction End-to-end configuration for vSAN with RDMA
Network configuration and setup
High Level Overview PCP + PFC + ECN configuration Example PCP + PFC configuration Example
PowerEdge server BIOS and NIC Firmware configurations
ESXi driver parameters
vSAN configuration
A vSAN with RDMA integration
Hardware/Software Details
Best Practices for vSAN with RDMA Conclusion Glossary References

PowerEdge server BIOS and NIC Firmware configurations

Home > Integrated Products > vSAN Ready Nodes > White Papers > End to end vSAN deployment with RDMA > PowerEdge server BIOS and NIC Firmware configurations

PowerEdge server BIOS and NIC Firmware configurations

    • There are no changes to be explicitly set at the PowerEdge BIOS level to support RDMA RoCE traffic. Set to default settings for PowerEdge server BIOS.
    • Ensure to choose a network interface card (NIC) supporting RDMA and is certified for vSAN traffic. Refer to VMware VCG to choose the right NIC model for your RDMA enabled vSAN cluster. This whitepaper details the settings specific to Broadcom Network cards and don’t cover other vendor based RDMA supported NICs.
    • The screenshots below are taken from a Broadcom BCM57504 NIC,  are supported for RDMA traffic, and is certified for vSAN. Traverse to ‘IO Device Settings’ in server BIOS and select the NIC. Upon selecting the NIC, the device level configuration provides an option to set DCBX mode. The NIC configuration page provide an option to enable NIC + RDMA mode which is otherwise set to disabled by default.

    Enabling DCBX mode in NIC firmware

    Figure 1.   Enable DCBX mode in NIC firmware

    Enabling EDMA in NIC firmware

    Figure 2.   Enable RDMA at NIC Firmware