Design Guide—Generative AI in the Enterprise - Inferencing

• 1

  Overview
• 2

  Document purpose
• 3

  Audience

• 1

  Introduction
• 2

  What is inferencing?
• 3

  Inferencing and AI model development workflow
• 4

  Inferencing use cases
• 5

  Challenges with inferencing

• 1

  Introduction
• 2

  Large language models
• 3

  Dell PowerEdge Servers and NVIDIA GPUs
• 4

  Inferencing software components

• 1

  Architecture overview
• 2

  Physical architecture
• 3

  Software architecture

• 1

  Introduction
• 2

  Generative AI model validation

• 1

  Overview
• 2

  Performance test results
• 3

  Sizing guidelines

• 1

  Model deployment
• 2

  Life cycle
• 3

  Backup and restore
• 4

  Secure model serving
• 5

  Model monitoring

• 1

  Introduction
• 2

  Advisory Services for Generative AI
• 3

  Implementation Services for Generative AI
• 4

  Adoption Services for Generative AI
• 5

  Scale Services for Generative AI

• 1

  Summary
• 2

  We value your feedback

• 1

  Dell Technologies documentation
• 2

  NVIDIA documentation
• 3

  Other documentation