Dell infrastructure provides the compute, memory, storage, and network resources for the platform. Modern data stack on Dell infrastructure illustrates the required infrastructure components and their roles in the cluster.
- Control plane nodes
- Cluster control plane components make global decisions such as scheduling, and detecting and responding to cluster events. Such events can include starting a new pod when replicas are unsatisfied in a deployment.
- Worker nodes
- These nodes are used to run containerized workloads. The Kubernetes control plane controls each node through the kubelet agent. The kubelet connects to the control plane and synchronizes the node state with the cluster.
- Storage infrastructure
- Storage infrastructure provides the modern data stack storage layer. Dell ObjectScale, PowerScale, and ECS configurations are provided. You can use any of them as modern data stack storage. The CSI driver for Dell PowerStore has been incorporated into Kubernetes to provide persistent storage.
- Network infrastructure
- Network infrastructure provides the required connectivity between the server and storage infrastructure and the on-premises network.
The architecture is flexible and supports a wide range of infrastructure configurations. Dell Technologies recommends the following configurations for a general-purpose modern data stack environment running analytics workloads. Individual node configurations include node-specific guidance. More guidance for cluster level sizing and scaling is provided in Sizing the solution. Design guides for individual solutions on the platform may include more specific recommendations for those solutions.