Home > Servers > Rack and Tower Servers > Intel > White Papers > Driving GenAI Advancements: Dell PowerEdge R760 with the Latest 5th Gen Intel® Xeon® Scalable Processors > Overview
The introduction of new server technologies not only allows customers to deploy solutions using the newly introduced functionality but also provides an opportunity to review their current infrastructure and determine if the new technology might increase performance and efficiency. With a paradigm shift in AI with the burst of Generative-AI use cases, Dell Technologies and Intel® recently conducted Large Language Model (LLMs) performance testing of a Kubernetes-based Enterprise AI solution on the new Dell PowerEdge R760 with 5th-generation Intel® Xeon® Scalable processors for 2 use cases: 1) Next-token latency requirements of real-time chatbots, and 2) Fine-tuning LLM models to showcase if customers could benefit from this platform.
Some of the key optimizations which power these LLM use cases on the Dell PowerEdge R760 with 5th generation Intel® Xeon® Scalable processors include:
All DDR5-5600 MT/s memory for this testing was supplied by Micron.
All testing was conducted in Dell Labs by Intel® and Dell Technologies Engineers in November and December 2023.