Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Generative AI in the Enterprise
Introduction Generative AI background and concepts Business and technical challenges Benefits Use cases Dell and NVIDIA solution architecture Infrastructure component considerations for AI Dell infrastructure and software components
Introduction
Dell PowerEdge servers
Dell file storage
Dell object storage
Dell PowerSwitch networking
Dell OpenManage Enterprise
Dell OpenManage Enterprise Power Manager
Dell CloudIQ
Dell Services
NVIDIA infrastructure and software components System Configurations Conclusion References

Dell PowerEdge servers

Dell PowerEdge servers

  • Dell Technologies offers a range of acceleration-optimized servers and an extensive acceleration portfolio with NVIDIA GPUs. Two Dell servers are featured in the solution for generative AI.

    The PowerEdge adaptive compute approach enables servers engineered to optimize the latest technology advances for predictable profitable outcomes. The improvements in the PowerEdge portfolio include:

    • Focus on acceleration—Support for the most complete portfolio of GPUs, delivering maximum performance for AI, machine learning, and deep learning training and inferencing, high performance computing (HPC) modeling and simulation, advanced analytics, and rich-collaboration application suites and workloads
    • Thoughtful thermal design—New thermal solutions and designs to address dense heat-producing components, and in some cases, front-to-back, air-cooled designs
    • Dell multivector cooling—Streamlined, advanced thermal design for airflow pathways within the server

    PowerEdge XE9680 server

    The PowerEdge XE9680 server is a high-performance application server made for demanding AI, machine learning, and deep learning workloads that enable you to rapidly develop, train, and deploy large machine learning models. 

    The PowerEdge XE9680 server is the industry’s first server to ship with eight NVIDIA H100 GPUs and NVIDIA AI software. It is designed to maximize AI throughput, providing enterprises with a highly refined, systemized, and scalable platform to help them achieve breakthroughs in NLP, recommender systems, data analytics, and more. 

    Its 6U air-cooled design chassis supports the highest wattage next-generation technologies up to 35C ambient. It features nine times more performance and two times faster networking with NVIDIA ConnectX-7 smart network interface cards (SmartNICs), and high-speed scalability for NVIDIA SuperPOD. 

    PowerEdge XE8640 server

    The PowerEdge XE8640 server is an air-cooled 4U performance-optimized server featuring four NVIDIA H100 Tensor Core GPUs and NVIDIA NVLink technology, along with two upcoming 4th Gen Intel Xeon Scalable processors. It is designed to help businesses develop, train, and deploy machine learning models to accelerate and automate analysis. 

    PowerEdge R760xa server

    Optimized for PCIe GPUs, the dual-socket 2U PowerEdge R760xa server enables businesses to accelerate a wide variety of applications including AI training and inferencing, analytics, virtualization, and performance rendering applications, all within an air-cooled design. The PowerEdge R760xa server delivers outstanding performance using Intel CPUs and supports a diverse set of GPU accelerators from AMD, Intel, and NVIDIA to drive a large and powerful range of demanding processing needs. Deploy and enable demanding graphics applications and dense AI inferencing applications business-wide with powerful features and capabilities, using the latest technology.