Dell Enterprise SONiC Flexible and Robust VLAN QinQ, VXLAN, and VLAN Translation Solutions
Wed, 24 May 2023 17:24:24 -0000
|Read Time: 0 minutes
As a corporate business grows through mergers, acquisitions, and expansions, it must add or extend new business branches in many different locations. The network infrastructure must evolve to accommodate these new locations. Compute and network virtualization have also brought strong demand and requirements to transport local VLAN over WAN (Wide Area Network), Telco (Telecommunication), and many other network infrastructures.
Figure 1. Transport VLAN network through WAN network
In Figure 1, Laptop 1 is connected to the corporate network in San Francisco. Soon after, Laptop 2 was added to the same corporate network in New York. The users of these two laptops are in the same corporate business unit (BU), such as engineering, finance, or HR. Corporate IT wants to apply the same set of policies for network access, security, and service to these laptops. These policies are implemented through VLAN IDs, subnets, and other network provision parameters. Therefore, IT must transport the VLAN ID over WAN and its network infrastructures. Often, on corporate networks, endpoints must be on the same VLAN. These endpoints can be laptops, VMs, applications, and Virtual Network Function (VNF) entities, to name a few.
To help customers meet these network transport requirements, Dell Enterprise SONiC has built the new IEEE 802.1ad VLAN QinQ feature. This feature adds another VLAN tag in the original dot1q frame, creating a double-tagged VLAN frame.
The figures below demonstrate how the outer tag is used to identify the Telco provider’s traffic, while the inner tag is still the local dot1q VLAN ID. This process allows endpoints to use the same VLAN ID while traveling through Telco network infrastructures.
Figure 2. VLAN QinQ frame
Figure 3. Transport local dot1q VLAN over VLAN QinQ enables switches
Dell Enterprise SONiC VXLAN (Virtual Extensible LAN) solution is designed to transport VLANs in Layer 4, the User Datagram Protocol (UDP) transport layer, which is defined in the Open Systems Interconnection (OSI) model. Packets that VXLAN encapsulates are not aware of the underlay networking protocols.
The figures below demonstrate how the VXLAN IP/UDP header is created in a VXLAN tunnel endpoint (VTEP) ingress tunnel server and decapsulated in the egress VTEP server.
Figure 4. VXLAN header to encapsulate dot1q VLAN frame
Figure 5. Transport dot1q VLAN frame over VXLAN enabled network infrastructure
Network infrastructures in Telco, Communication Service Provider (CSP), data center, and cloud providers often consist of different types of VLAN transportation technologies like QinQ, VXLAN, and dot1q. To transport VLAN frames over a mix of VLAN protocol networks, Dell Enterprise SONiC introduces the VLAN translation feature with the following options:
- Dynamically modify the tag in a single tag VLAN frame
- Dynamically modify one tag and remove the other in a double tag VLAN frame
Figure 6. VLAN translation to modify VLAN tags
Figure 7. Illustration of Dell SONiC VLAN translation, QinQ, and VXLAN sample scenarios
Network service providers constantly face technical challenges and stringent requirements. For example, one common challenge is determining how to scale bandwidth up and out to address fast and spontaneous traffic growth. Other challenge include protecting and securing the networks through user and tenant isolations, or improving network efficiency.
Open source-based SONiC network software provides rapid feature development and a broad selection of network orchestration tools through a vibrant ecosystem and community. On top of that, Dell Enterprise SONiC has added special features and verifications, such as world class technical support for Dell networking hardware. This support can improve network security and flexibility, as well as increase network provisioning and monitoring capabilities.
Contact a Dell SONiC sales representative for additional information about Dell Enterprise SONiC solutions and technologies.
Contact Dell SONiC Sales representatives
Resources
To learn more about Dell Enterprise SONiC features, see the Enterprise SONiC Spec Sheet.
To learn more about Enterprise SONiC Distribution by Dell Technologies, see Enterprise SONiC Networking Solutions, Enterprise SONiC Distribution By Dell Technologies, and Dell SONiC Solution Overview.
For more information about specific steps and commands, see the Dell SONiC User’s Guide available on the Dell Digital Library.
Related Blog Posts
Unlock the Power of RoCEv2 with Dell Enterprise SONiC: High-Speed Storage Transfer without Cost and Complexity
Mon, 22 May 2023 21:20:56 -0000
|Read Time: 0 minutes
In today's data-driven world, the demand for high-speed, low-latency data transfers is increasing exponentially. Traditional Ethernet networks are not designed to meet these demands, as they were primarily built for data integrity and networking reliability. As a result, organizations are turning to more advanced technologies like Remote Direct Memory Access (RDMA) to achieve faster data transfers.
Although RDMA is typically used in InfiniBand (IB) networks, which are complex and expensive to deploy, RDMA over Converged Ethernet (RoCE) has emerged as a more accessible solution.
In this blog, we will explore the benefits of RoCE and how Dell Enterprise SONiC can help you take advantage of this powerful technology. Keep reading if you want to:
- Understand what RoCEv2 is and how it can benefit your organization
- Find ways to optimize your storage networking and achieve faster data transfer speeds
- Learn how the power combination of RoCEv2 and Dell Enterprise SONiC will help you achieve unparalleled data transfer speeds and reliability
What is RoCE?
RDMA Consortium—a group of industry leaders that includes Dell Technologies—developed RoCE to address the need for faster, more efficient data transfers in modern data centers. The first version of RoCEv1 was released in 2010 and supported Layer2 ethernet encapsulation for RDMA.
RoCEv2 was introduced in 2014 and builds on the original RoCEv1 protocol. It added key features such as support for routing and congestion control, making RoCEv2 a more robust and scalable solution for modern data centers.
How does RoCEv2 work?
RoCEv2 enables RDMA over Ethernet networks by using the Ethernet header and payload to transport RDMA messages.
Below is an example of two RDMA-aware servers connected using an Ethernet fabric enabled with RoCEv2:
- The sending NIC prepares an RDMA message by copying data directly from the local memory into the NIC's send buffer. The message can be for example, to initiate an RDMA write operation, specifying the destination server’s memory address and the amount of data to be transferred.
- The RDMA message is translated into an Ethernet frame by encapsulation and sent over the Ethernet fabric to the receiving NIC.
- The receiving NIC receives the packet, decapsulates it from the Ethernet frame, and copies the data from the RDMA message directly to the remote memory.
Because RoCEv2 bypasses the CPU and operates directly on the memory, it can achieve lower latency and overhead than traditional network communication. This makes RoCEv2 ideal for high-performance computing applications that require fast data transfers such as machine learning, big data analytics, and scientific computing.
How does RoCE help with storage networking?
RoCEv2 is a technology that provides high-speed, low-latency data transfers by leveraging RDMA over Ethernet networks. As such, it is well suited for storage networking applications, where fast and reliable data transfers are critical.
Additionally, RoCEv2 is designed to be compatible with existing ethernet infrastructure. This makes it a powerful tool for organizations looking to improve storage networking performance without significant infrastructure upgrades or changes to their existing storage environment.
What is Dell Enterprise SONiC?
Dell Enterprise SONiC is based on an open-source network operating system, designed to provide a flexible and scalable platform for building and managing modern data center networks. SONiC can build efficient and customizable network infrastructures and supports various networking protocols such as Layer 2 and Layer 3 forwarding, BGP, OSPF, VXLAN, and EVPN. It can also extend functionality with custom modules through third-party container management.
A typical RoCEv2 deployment with Enterprise SONiC
In a typical Data Center topology based on Leaf/Spine architecture, the S-series S52xx-ON family of switches plays the role of Leaf while Z-series Z93xx-ON plays as Spine.
Leaf switches are connected to servers and storage devices, while Spine switches are used to interconnect the Leaf switches.
Servers and storage have NICs that are RoCEv2 enabled:
The Layer 2 connectivity of server and storage devices terminates at Leaf. L3 routing is enabled between leaf/spine and uses dynamic routing protocol like BGP to learn all the end points in the network.
The following protocols enable Switch fabric to provide the quality of service (QoS) needed for zero packet loss and to schedule higher priority switching for storage traffic:
- Priority Flow Control (PFC) – provides congestion management by avoiding buffer overflow and achieves zero-packet loss by generating priority-based pause towards the downstream switch
- Enhanced Transmission Control (ETS) – allocates specific bandwidth to each class of service to prevent a single class of traffic hogging the bandwidth
- Explicit Congestion Notification (ECN) – marks packets when the buffer overflow is detected; end hosts check the marked packet and slow down transmission
- Data center bridging protocol – operates with link layer discovery protocol to negotiate QoS capabilities between end points or switches
In terms of operations, Packets are classified and prioritized based on whether it is storage traffic or not at the ingress Leaf. They are tested for congestion at each subsequent switch in the path of the packet towards the destination server.
How does Enterprise SONiC take advantage of RoCEv2?
Enterprise SONiC supports a wide range of capabilities, including modular architecture based on docker container technology, easy automation, third-party container management (TPCM), and other comprehensive features that allow deployment at Enterprise, Edge, and Provider networks. Networks that combine Enterprise SONiC and RoCEv2 can help organizations build high performing, reliable, and scalable network infrastructures.
The most important benefit of RoCEv2 with SONiC is that it reduces the complexity of configuring RoCEv2 to a single CLI command (command: roce enable]. This addresses one of the major complaints against RoCEv2 as being difficult to configure as there are several features to handle like buffering, traffic classification, mapping, queuing, scheduling, priority flow control, congestion management.
Additionally, it is also necessary to ensure that these features and parameters align with switch hardware resources. Not only does the single CLI command address this concern, but it also lends a big differentiator to the solution.
TPCM allows flexibility for deploying any third party developed management tools to monitor RoCEv2 or any other applications.
Why Dell Technologies?
With its expertise in networking and storage, Dell Technologies is uniquely positioned to help customers unlock the full potential of RoCEv2. This end-to-end solution ensures a seamless and reliable deployment, from the server to the storage array, leveraging advanced features like ECN and PFC to minimize congestion and maximize performance.
As data centers continue to evolve, the demand for faster and more efficient data transfers will only increase. RoCEv2 is a catalyst of this transformation, and Dell Technologies is at the forefront. With its powerful combination of technology, expertise, and support, Dell Technologies is well positioned to help customers meet their business goals—today and in the future.
How do I learn more?
- See Enterprise SONiC Spec Sheet for more information about Dell Technologies Enterprise SONiC features.
- See Enterprise SONiC Networking Solutions to learn more about Enterprise SONiC Distribution by Dell Technologies.
Dell Enterprise SONiC Distribution and Hyperconverged, converged infrastructure (H/CI)
Tue, 12 Sep 2023 16:43:10 -0000
|Read Time: 0 minutes
Hyperconverged or converged infrastructures (H/CI) combine key integrated components such as storage, compute, and networking into a single appliance to deliver scalable and high-performance resources.
Compared to a non-converged infrastructure—which requires separate, independent teams to converge in order to deliver business applications—H/Cl integration streamlines data center operations.
However, you need a fabric to connect these highly efficient appliances—and fabrics have distinct hardware and software requirements. Without the fabric, these appliances are underutilized, operate separately, and are unable to leverage their powerful resources. The fabric and related hardware and software features (Layer 2 and Layer 3) that interconnect these appliances are crucial.
Enterprise SONiC Distribution by Dell Technologies: a great fit for H/CI
Enterprise SONiC Distribution by Dell Technologies provides the necessary Layer 2 and Layer 3 features and protocols that enable a robust Ethernet fabric. Dell Enterprise SONiC is a modular, scalable, and purpose-built architecture leveraging open networking standards.
You can use Dell Enterprise SONiC to build a variety of converged infrastructure architectures, ranging from a single VxRail appliance to a single cluster or a stretched cluster in a single site.
Through Dell’s Enterprise SONiC EVPN VXLAN implementation, you can build networking overlays that make resources look like they are part of a large, common resource pool. One primary use case representing this common pool is virtualization in data centers.
Figure 1 shows a typical Layer 2 or Layer 3 Dell Enterprise SONiC and VxRail appliances (both single and cluster).
A solid foundation
The foundation of a house is similar to an Ethernet fabric, while the roof, framing, and electrical systems represent the integrated components of a Converged Infrastructure appliance. A well-designed Ethernet fabric is just as important as the foundation of a well-built house.
Dell Enterprise SONiC builds and expands on this foundation by providing a robust set of networking Layer 2 and Layer 3 features.
For more information about Dell Enterprise SONiC Distribution and for a detailed VxRail deployment guide with Dell Enterprise SONiC, see: