Home > Servers > PowerEdge Cyber Security > White Papers > Securing AI workloads on Dell PowerEdge with Intel Xeon processors using Intel Trust Domain Extensions > What is Intel® AMX
Dell PowerEdge 16th generation with 5th Gen Intel® Xeon® processors support AMX and can handle the computational demands of Generative AI workloads more efficiently, allowing users to run these workloads without the need for additional specialized hardware and making it more accessible and cost-effective to utilize Generative AI capabilities.
To help increase the efficiency and cost-effectiveness of your deep learning workloads and make them easier to train and deploy, Intel® AMX on Intel® Xeon® Scalable processors delivers acceleration for inferencing and training while minimizing the need for specialized hardware. Intel® AMX is a dedicated hardware block found on the Intel® Xeon® Scalable processor core that helps optimize and accelerate deep learning training and inferencing workloads that rely on matrix math.
Intel® AMX can help with running Generative AI workloads without the need for specialized hardware by providing accelerated matrix operations. Generative AI involves complex computations, particularly in tasks like image generation, natural language processing, and deep learning. These workloads heavily rely on matrix operations, which can be computationally intensive. Intel® AMX introduces a new set of x86 instructions specifically designed to accelerate matrix operations. By leveraging Intel® AMX, software developers can optimize their Generative AI algorithms to take advantage of these instructions, resulting in improved performance and faster execution of matrix operations without necessitating specialized hardware.
Intel® AMX enables AI workloads to run on the CPU instead of offloading them to a discrete accelerator, providing a significant performance boost.2 Its architecture supports BF16 (training/inference) and int8 (inference) data types and includes two main components:
Together, these components enable Intel® AMX to store more data in each core and compute larger matrices in a single operation. Additionally, Intel® AMX is architected to be fully extensible and scalable.
Dell PowerEdge 16th generation with 5th Gen Intel® Xeon® processors and Intel® AMX acceleration offers a cost-effective and efficient solution for AI deployment optimization. Organizations can reduce costs to effectively run AI workloads without the need for specialized hardware while also gaining enhanced versatility and simplicity, allowing organizations to run any workload, including AI. With this optimization, organizations can maximize their AI deployment efficiency while minimizing expenses.