Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Design Guide—Generative AI in the Enterprise – Model Customization
Introduction Customizing Large Language Models Solution Components Solution Architecture Validation Results Performance Characterization
Overview
Performance test results
Sizing and scaling guidelines
Dell Professional Services for Generative AI Conclusion References Sample Scripts

Sizing and scaling guidelines

Sizing and scaling guidelines

  • Enterprises seeking to embrace generative AI are likely to embark on multiple projects, each requiring various trained and customized models. Deploying a cluster of PowerEdge XE9680 servers managed by NVIDIA Base Command Manager Essentials equips customers with a high-performance environment for training and fine-tuning multiple models. As demand grows, the cluster's size can be effortlessly expanded using Base Command Manager. Newly added servers can seamlessly join the cluster and be deployed using the same image as the existing PowerEdge XE9680 servers, facilitating a straightforward scaling process.

    The current configuration accommodates up to eight PowerEdge XE9680 servers. Beyond this capacity, consider the switching options and topology for further expansion.