Dell Networking PowerSwitch for AI Distributed Fine-tuning

• 1

  Executive summary
  • Document purpose
  • Distributed fine-tuning project scope

• 1

  Overview
• 2

  Dell PowerSwitch Z9664f-ON

• 1

  Overview
• 2

  Cluster configuration for fine-tuning Llama 2 7 B LLM model
• 3

  Network efficiency

• 1

  Overview
• 2

  AI fabrics
• 3

  Example leaf-spine fabric
• 4

  Dell Enterprise SONiC features for GenAI workloads
• 5

  Best practices

• 1

  Overview
• 2

  Conclusion
• 3

  References