Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Design Guide—Generative AI in the Enterprise - Inferencing
Introduction
Overview
Document purpose
Audience
AI Model Inferencing Architecture Concepts and Components Solution Architecture Validation Results Performance Characterization and Sizing Inferencing Operations Dell Professional Services for Generative AI Conclusion References

Document purpose

Document purpose

  • This guide describes the Dell Validated Design for Generative AI Inferencing with NVIDIA.

    It describes the validated design and reference architecture for a modular and scalable platform for generative AI in the enterprise. The guide focuses specifically on inferencing, which is the process of using a trained model to generate predictions, make decisions, or produce outputs based on input data for production outcomes. Subsequent guides will address validated designs for model customization and training.

    This design guide can be read alongside the associated white paper, Generative AI in the Enterprise. The white paper provides an overview of generative AI, including its underlying principles, benefits, architectures, and techniques; the various types of generative AI models and how they are used in real-world applications; the challenges and limitations of generative AI; and descriptions of the various Dell and NVIDIA hardware and software components to be used in the series of validated designs to be released.