Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Design Guide—Modern Data Stack with Symcloud Platform and Delta Lake with Intel
Revision history Introduction Solution concepts Solution architecture
Solution architecture
Architecture overview
Design overview Platform features
Dell infrastructure
Infrastructure overview Server infrastructure Storage infrastructure Network infrastructure
Container platform implementation
Container platform overview Symcloud Platform roles Orchestration Compute Storage Management and administration Network
Workload design
Overview Spark bundle Kafka bundle
Software infrastructure validation Sizing the solution Summary References

Workload design

Home > Workload Solutions > Data Analytics > Guides > Design Guide—Modern Data Stack with Symcloud Platform and Delta Lake with Intel > Workload design

Workload design

  • Spark bundle

    The Spark application bundle deploys an Apache Spark 3.4.1 stand-alone cluster. The figure below shows the application creation screen for the Spark bundle.

    Figure 6. Spark 3.4.1 application creation screen
    Robin CNP Spark 3.3 app bundle creation screen

    This bundle includes:

    • Apache Spark 3.4.1
    • Hadoop client libraries (for HDFS access)
    • Hadoop AWS libraries (for S3 access)
    • Delta Lake 2.4.0 and 3.0.0rc1 libraries
    • NVIDIA CUDA 11.4 (for GPU support)
    • NVIDIA RAPIDS Accelerator for Apache Spark (for Spark GPU support)

    At application creation time, the numbers of both Spark workers and Spark GPU workers can be specified. The bundle also allows resources to be specified, including number of cores and memory per worker.