Design Guide—Generative AI in the Enterprise - Inferencing

• 1
  Overview
• 2
  Document purpose
• 3
  Audience

• 1
  Introduction
• 2
  What is inferencing?
• 3
  Inferencing and AI model development workflow
• 4
  Inferencing use cases
• 5
  Challenges with inferencing

• 1
  Introduction
• 2
  Large language models
• 3
  Dell PowerEdge Servers and NVIDIA GPUs
• 4
  Inferencing software components

• 1
  Architecture overview
• 2
  Physical architecture
• 3
  Software architecture

• 1
  Introduction
• 2
  Generative AI model validation

• 1
  Overview
• 2
  Performance test results
• 3
  Sizing guidelines

• 1
  Model deployment
• 2
  Life cycle
• 3
  Backup and restore
• 4
  Secure model serving
• 5
  Model monitoring

• 1
  Introduction
• 2
  Advisory Services for Generative AI
• 3
  Implementation Services for Generative AI
• 4
  Adoption Services for Generative AI
• 5
  Scale Services for Generative AI

• 1
  Summary
• 2
  We value your feedback

• 1
  Dell Technologies documentation
• 2
  NVIDIA documentation
• 3
  Other documentation