Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Design Guide—Modern Data Stack with Symcloud Platform and Delta Lake with Intel
Revision history Introduction Solution concepts Solution architecture
Solution architecture
Architecture overview
Design overview Platform features
Dell infrastructure
Infrastructure overview Server infrastructure Storage infrastructure Network infrastructure
Container platform implementation
Container platform overview Symcloud Platform roles Orchestration Compute Storage Management and administration Network
Workload design
Overview Spark bundle Kafka bundle
Software infrastructure validation Sizing the solution Summary References

Dell infrastructure

Home > Workload Solutions > Data Analytics > Guides > Design Guide—Modern Data Stack with Symcloud Platform and Delta Lake with Intel > Dell infrastructure

Dell infrastructure

  • Network infrastructure

    The network is designed to meet the needs of a high performance and scalable cluster, while providing redundancy and access to management capabilities. The architecture is a leaf and spine model that is based on Ethernet networking technologies. It uses PowerSwitch S5248F-ON switches for the leaves and PowerSwitch Z9432F-ON switches for the spine.

    Physical networking in this architecture is straightforward since most of the advanced capabilities of the system are implemented using software defined networking. The logical network is described in Container platform implementation. This architecture has three physical networks, as shown in Physical network infrastructure.

    iDRAC (or BMC) network
    The iDRAC (or BMC) network is a secured and isolated network for switch and server hardware management, including access to the iDRAC9 module and Serial-over-LAN. This network optionally connects to corporate network management allowing more direct access to the hardware infrastructure. Each node on this network is assigned an individual IP address from the management address space.
    Cluster data network
    The Cluster data network is the primary network for internode communication between all server and storage nodes. Each server node on this network is assigned a single IP address on this network.
    Core data center network
    The Core data center network is the existing enterprise network. The Cluster data network is interfaced with this network through switching and routing allowing cluster services to be exposed to system users.
    Figure 3. Physical network infrastructure
    Lakehouse physical network infrastructure graphic

    Management network fabric

    The management network uses a PowerSwitch S3148 1 GbE switch for iDRAC connectivity and chassis management.

    Cluster data network fabric

    The Cluster data network uses a scalable, resilient, nonblocking fabric with a leaf-spine design as shown in Cluster data network connections. Each node on this network is connected to two S5248F-ON leaf switches with 25 GbE network interfaces. The switches run Dell SmartFabric OS10. SmartFabric OS10 enables multilayered disaggregation of network functions that are layered on an open-source Linux-based operating system.

    On the server side, the two network connections are bonded and have a single IP address assigned.

    On the switch side, the network design employs a Virtual Link Trunking (VLT) connection between the two leaf switches.

    VLT technology enables a server to uplink multiple physical trunks into more than one S5248F-ON switch by treating the uplinks as one logical trunk. In a VLT environment, connected pair of switches acts as a single switch to a connecting server while all paths are active. It is possible to achieve high throughput while still providing resiliency against hardware failures. VLT replaces Spanning Tree Protocol (STP)-based networks, providing both redundancy and full bandwidth utilization using multiple active paths.

    The VLT configuration in this design uses four 100 GbE ports between each Top of Rack (ToR) switch. The remaining 100 GbE ports can be used for high-speed connectivity to spine switches, or directly to the data center core network infrastructure.

    Figure 4. Cluster data network connections
    Cluster data network connections graphic