Home > Workload Solutions > High Performance Computing > White Papers > Dell Validated Design for HPC NG-Stor Storage - Joint Solution with Kalray > Introduction
Modern HPC environments require high-speed storage to keep up with the demands of high core count CPUs, larger and faster memory, a faster PCIe bus, and increasingly faster networks. Otherwise, storage can become a bottleneck. PFS are designed to address these high-demand HPC requirements and help optimize performance. They provide concurrent access to a single file or a set of files from multiple nodes, efficiently and securely distributing data to multiple LUNs across several storage servers.
PFS are based on spinning media to provide the highest capacity at the lowest cost. When the speed and latency of spinning disk media cannot keep up with the demands of modern HPC workloads, the use of flash technology in the form of burst buffers, faster tiers, or fast scratch (local or distributed) can mitigate this issue. The HPC NG-Stor Storage solution offers both storage nodes based on the PowerVault ME5084 arrays for a cost-effective high-capacity tier and NVMe nodes to cover high-bandwidth, low-latency demands and the HDMD module, enabling a flexible, scalable, efficient, and reliable storage solution.
Frequently, data cannot be accessed using the native PFS client software that is used to access such data. Instead, other protocols like NFS or SMB must be used. An example is when customers require access to data from Microsoft Windows or Apple macOS workstations or laptops that are restricted from installing the PFS client software, or research or production systems that only offer connectivity using standard protocols. The Dell Ready Solution for HPC NG-Stor Storage uses gateway nodes to allow such connectivity with scalable performance efficiently and reliably.
Storage solutions frequently require access to other storage devices (local or remote) to move data to and from those devices. An example is when the NG-Stor gateway is not the most appropriate choice or if it is best to integrate those devices as another tier to the NG-Stor system (for example, adding object storage, cloud storage, tape libraries, and so on). Under those circumstances, the NG-Stor solution provides tiered access to other storage devices. It can use other enterprise protocols such as NFS or SMB, including cloud protocols such as S3, and using NG-Hub nodes with Kalray proprietary software that allows that level of integration while remaining cost effective.