You can choose from several Dell EMC PowerEdge servers to deploy your AI applications at the edge. Dell EMC PowerEdge XE2420 servers are purpose-built for the edge and NVIDIA-Certified for AI applications.
PowerEdge servers support NVIDIA T4 Tensor Core GPUs for AI inference. The NVIDIA T4 GPU is a single-slot, low profile, PCI Express (PCIe) Gen3 accelerator card that is based on the NVIDIA TU104 GPU. The T4 GPU is a passively cooled board that has 16 GB GDDR6 memory and a 70 W maximum power limit. NVIDIA Turing™ Tensor Cores power the T4 GPU to accelerate inference, video transcoding, and virtual desktops. The small PCIe form factor and energy efficiency of the T4 make it an ideal accelerator for inference at the edge.
The following table lists the rack server options that provide an optimum balance of computing power, memory, and GPU performance:
Table 1. Server options
PowerEdge R650 | Dual-socket 3rd Gen Intel Xeon scalable processors | 32 DIMMs | 1 or 2 | In progress (Certification is in progress. This guide will be updated when certification for these servers is complete.) |
PowerEdge R750xa | Dual-socket 3rd Gen Intel Xeon scalable processors | 32 DIMMs | 1, 2, or 4 | In progress (Certification is in progress. This guide will be updated when certification for these servers is complete.) |
PowerEdge R6515 | Single-socket 2nd Gen AMD EPYC processor | 16 DIMMS | 1 | NVIDIA NGC-Ready™ |
PowerEdge R7515 | Single-socket 2nd Gen AMD EPYC processors | 16 DIMMS | 1, 2, or 4 | NGC-Ready |
PowerEdge R6525 | Dual-socket 2nd Gen AMD EPYC processors | 32 DIMMS | 1 or 2 | NGC-Ready |
PowerEdge R7525 | Dual-socket 2nd Gen AMD EPYC processors | 32 DIMMS | 1, 2, or 4 | NVIDIA-Certified System for T4 |
PowerEdge R940xa | Quad-socket 2nd Gen Intel Xeon scalable processors | 48 DIMMS | 1, 2, or 4 | NGC-Ready |
Dell EMC DSS 8840 | Dual-socket 2nd Gen Intel Xeon scalable processors | 24 DIMMS | 1, 2, or 4 | NGC-Ready |
PowerEdge XE2420 | Dual-socket 2nd Gen Intel Xeon scalable processors (maximum 150 W Gold) | 16 DIMMs | 1, 2, or 4 | NGC-Ready |
PowerEdge R640 | Dual-socket 2nd Gen Intel Xeon scalable processors | 24 DIMMs | 1 or 2 | NGC-Ready |
PowerEdge R740 | Dual-socket 2nd Gen Intel Xeon scalable processors | 24 DIMMs | 1, 2, or 4 | NVIDIA-Certified System for T4 |
PowerEdge R740xd | Dual-socket 2nd Gen Intel Xeon scalable processors | 24 DIMMs | 1, 2, or 4 | NVIDIA-Certified System for T4 |