Home > Storage > PowerScale (Isilon) > Industry Solutions and Verticals > Analytics > PowerScale Deep Learning Infrastructure with NVIDIA DGX A100 Systems for Autonomous Driving > Summary
This document discussed key features of the scale-out NAS Dell EMC PowerScale as a powerful persistent storage solution for ADAS DL solutions. We presented a powerful and robust hardware architecture for DL by combining NVIDIA DGX A100 systems with embedded NVIDIA A100 GPUs and all-flash PowerScale storage. We ran several object detections and reported system performance based on the rate of images processed and throughput profile of I/O to disk. We also monitored and reported the CPU, GPU utilization and memory statistics that demonstrated that the system, GPU, and memory resources were fully utilized while the Dell EMC PowerScale was still capable of providing more I/O.
DL algorithms have a diverse set of requirements with various compute, memory, I/O, and disk capacity profiles. That said, the architecture and the performance data points presented in this whitepaper can be utilized as the starting point for building DL solutions tailored to varied set of resource requirements. More importantly, all the components of this architecture are linearly scalable and can be expanded to provide DL solutions that can manage tens to thousands of petabytes of data.
While the solution presented here provides several performance data points and speaks to the effectiveness of PowerScale in handling large scale DL workloads, there are several other operational benefits of persistent data for DL on PowerScale:
In summary, PowerScale based DL solutions deliver the capacity, flexible performance, and high concurrency to eliminate the I/O storage bottlenecks for AI. The DGX A100 system delivers over twice the training performance of an eight V100 GPU system, such as the DGX-1 system using the same cityscapes dataset. This provides a solid foundation for large scale, enterprise-grade DL solutions with a future proof scale-out architecture that meets your AI needs of today and scales for the future.