Dell EMC Integrated System for Microsoft Azure Stack HCI is configured in the fully converged or non-converged network topology with the following adapters:
- Mellanox ConnectX-4 Lx
- Mellanox ConnectX-5 LX
- Mellanox ConnectX-6 DX
These adapters require DCB configuration on the ToR switches and Quality of Service (QoS) configuration in the host operating system. Also, the high-performance all NVMe configurations using QLogic network adapters may also need the DCB and QoS configurations described in this section.
Ensure that the QoS policies are configured to prioritize the SMB traffic related to the storage adapters. Ensure that the QoS configuration in the host operating system matches the QoS configuration that is performed in the network switch configuration.
The following tables provide an overview of QoS priorities and the required state for the set of priorities.
QoS priority | QoS flow control | Purpose |
0-2,4,6,7 | Disabled | 0 - Best effort traffic |
3 | Enabled | RDMA |
5 | Disabled | Cluster network |
Network card on node | Fully converged switch topology | Non-converged switch topology | Switchless topology |
Mellanox (RoCE) | DCB (required) | DCB (required) for storage adapters only | No DCB/QoS required |
QLogic/Intel E810 (iWARP) | DCB (required for All-NVMe configurations only) | No DCB | No DCB/QoS required |
Disable-NetAdapterQos <nicName>
. Perform the following steps to configure QoS in the host operating system.
# Variables for the scenario
$StorageAdapters = @('SLOT 1 PORT 1','SLOT 1 PORT 2')
#New QoS policy with a match condition set to 445 (TCP Port 445 is dedicated for SMB)
#Arguments 3 and 5 to the PriorityValue8021Action parameter indicate the IEEE 802.1p #values for SMB and cluster traffic.
New-NetQosPolicy -Name 'SMB' –NetDirectPortMatchCondition 445 –PriorityValue8021Action 3
New-NetQosPolicy 'Cluster' -Cluster -PriorityValue8021Action 5
#Map the IEEE 802.1p priority enabled in the system to a traffic class
#Customer may change the bandwidth for the below traffic class based on their environments
New-NetQosTrafficClass -Name 'SMB' –Priority 3 –BandwidthPercentage 50 –Algorithm ETS
New-NetQosTrafficClass -Name 'Cluster' –Priority 5 –BandwidthPercentage 2 –Algorithm ETS
#Configure flow control for the priorities shown in the above table
Enable-NetQosFlowControl –Priority 3
Disable-NetQosFlowControl –Priority 0-2,4-7
#Enable QoS for the Mellanox network adapter ports.
foreach ($port in $StorageAdapters) {
Enable-NetAdapterQos –InterfaceAlias $port
}
#Disable DCBX Willing mode
Set-NetQosDcbxSetting -Willing $false
#Enable IEEE Priority Tag on all network interfaces to ensure the vSwitch does not drop the VLAN tag information.
$nics = Get-VMNetworkAdapter -ManagementOS
ForEach ($nic in $nics) {
Set-VMNetworkAdapter -VMNetworkAdapter $nic -IeeePriorityTag ON
}