Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Implementation Guide—Virtualizing GPUs for AI with VMware and NVIDIA Based on Dell Infrastructure
Introduction Solution Components
Hardware components
Software components
Deploying the Solution Verification Summary References

Hardware components

Home > AI Solutions > Artificial Intelligence > Guides > Implementation Guide—Virtualizing GPUs for AI with VMware and NVIDIA Based on Dell Infrastructure > Hardware components

Hardware components

  • The following table lists the hardware components that this validated design supports: 

    Table 1.      Hardware components

    Category

    Hardware components

    Compute server

    PowerEdge R760 and R7625 servers

    Number of nodes in a cluster (for vSphere with Tanzu and vSAN)

    Minimum of 3 nodes

    We recommend 4 ESXi hosts when using vSAN for resiliency during updating and upgrading.

    Network switch

    2 x Dell S5248F-ON 

    OOB switch

    1 x Dell N3248TE-ON

    The following table describes the recommended PowerEdge server hardware configuration:

    Table 2.      Recommended PowerEdge server configuration

    Category

    Hardware components

    Processor

    4th Generation Intel Xeon Scalable Processors for PowerEdge 16G servers

    Memory

    512 GB memory (recommended)

    GPUs

    NVIDIA A100 or A30 GPUs

    Network adapters

    ConnectX-6 LX 25 GbE

    Storage adapters

    BOSS controller card + with 2 M.2 Sticks 480 GB (RAID 1) – For ESXi

    HBA 355 – For vSAN 

    Internal storage

    Cache tier: 2 x 800 GB SSD SAS Mixed Use 

    Capacity tier: 6 x 1.92 TB SSD SAS Read Intensive

    OOB Management

    iDRAC Enterprise