Design Guide—Modern Data Stack with Symcloud Platform and Delta Lake with Intel

• 1

  Revision history

• 1

  Solution introduction
  • Overview
  • Document purpose
  • Audience
• 2

  Design Guide introduction

• 1

  Overview
• 2

  Introduction
• 3

  Concepts
  • Modern data stack architecture
  • Container platform
  • Decoupled compute and storage

• 1

  Solution architecture
• 2

  Architecture overview
  • Design overview
  • Platform features
• 3

  Dell infrastructure
  • Infrastructure overview
  • Server infrastructure
  • Storage infrastructure
  • Network infrastructure
• 4

  Container platform implementation
  • Container platform overview
  • Symcloud Platform roles
  • Orchestration
  • Compute
  • Storage
  • Management and administration
  • Network
• 5

  Workload design
  • Overview
  • Spark bundle
  • Kafka bundle

• 1

  Overview
• 2

  Introduction
• 3

  Software components
• 4

  Component validation
  • GPU validation
  • Platform validation
  • Spark validation
  • Kafka validation
  • High availability validation
• 5

  Findings
• 6

  Summary

• 1

  Overview
• 2

  Sizing and scaling overview
• 3

  Sizing guidelines
  • Cluster sizing
  • Modern data stack storage sizing
  • Control plane sizing
  • Worker node sizing
  • Workload sizing
• 4

  Scaling guidelines
  • Scaling overview
  • Compute scaling
  • Storage scaling
  • Network scaling

• 1

  Overview
• 2

  Conclusion
• 3

  We value your feedback

• 1

  Overview
• 2

  References
• 3

  Dell Technologies documentation
• 4

  Delta Lake documentation
• 5

  Symcloud documentation
• 6

  Dell Technologies Customer Solution Centers
• 7

  Dell Technologies Info Hub
• 8

  More information