Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
GPU Optimization with Run:ai Atlas
Introduction Overview of Run:ai Atlas platform Reference Architecture of Run:ai Atlas on Dell infrastructure
Summary
Use case validation for Run:ai Atlas Deployment Considerations Why Dell Technologies? Dell Technologies services and support The Dell Technologies Customer Solutions Center Conclusion References

Summary

Summary

  • Dell Technologies has worked closely with Run:ai to deliver GPU scheduling and orchestration through a jointly engineered and validated solution to help enterprises increase the use of their GPU-accelerated AI infrastructure. 

    The Run:ai Atlas solution is applicable to all the GPU-accelerated Dell PowerEdge servers, including the PowerEdge R7625, R7525, R760, R760xa, XE8640, XE9640, and XE9680 servers. Therefore, Run:ai Atlas is also applicable to Dell’s GPU-enabled solutions for AI and data analytics, including Generative AI in the Enterprise and the Validated Design for Analytics—Data Lakehouse.

    In this design, we validated Run:ai Atlas on the Symcloud Platform. The Symcloud Platform is validated as part of our Validated Design for Analytics—Data Lakehouse. 

    A screenshot of a computer programDescription automatically generated with low confidence

    Figure 2. Validated Design for AI -  Run:ai Atlas

    The reference architecture incorporates the following components: 

    • The Symcloud Platform is used for the Kubernetes layer. It is part of Dell’s Validated Design for Analytics—Data Lakehouse.
    • The Run:ai Atlas platform is used for GPU orchestration and scheduling.
    • PowerEdge servers provide compute resources, including GPUs for the AI projects.
    • Symcloud Storage provides the Kubernetes Storage Class by discovering disks attached to the PowerEdge servers. Run:ai Atlas self-hosted installations that require persistent volumes can use this Kubernetes Storage Class. 
    • Dell PowerSwitch components are used for networking.
    • NVIDIA GPU operator is used for managing NVIDIA GPU resources in a Kubernetes cluster.
    • MetalLB is the load balancer that provides a Run:ai Atlas self-hosted installation with external IP address. MetalLB is included as part of Symcloud Platform