Home > Workload Solutions > High Performance Computing > White Papers > Dell Validated Design for HPC NG-Stor Storage - Joint Solution with Kalray > NVMe Nodes
For PowerEdge R760 servers, each server has 16 NVMe E3.S PCIe 5 devices directly attached, eight to each CPU. Riser configuration 3-1 is used, with four Gen 4 slots not used, and two x16 Gen 5 in slots 2 and 7 populated with HCAs Mellanox ConnectX-7 Single Port NDR 400 Gbps adapters (one per CPU socket). Therefore, this configuration is a balanced configuration in terms of NUMA domains. Any NVMe device supported on the PowerEdge R760 server is supported for these NVMe nodes. Both CX7 interfaces are used actively to move data, replicate the NVMe NSDs, and provide connectivity from the file system to clients. In addition, they provide hardware redundancy at the adapter, port, and cable level; performance is affected if only one CX7 adapter is working. The LOM port 1 and iDRAC dedicated port are connected to the 1 GbE management network.
Figure 6. PowerEdge R760 NVMe node slot allocation