Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Generative AI in the Enterprise with AMD Accelerators
Introduction Concepts Solution Architecture Validation Results Performance Characterization
Benchmarking overview
Memory bandwidth
High Performance LINPACK for Accelerator Introspection
ROCm Communication Collectives Library Benchmarking
High-Performance Linpack
Benchmarking caveats
Dell Professional Services and Consulting Conclusion References Configuration file for LLM fine-tuning

High Performance LINPACK for Accelerator Introspection

Home > AI Solutions > Gen AI > Guides > Generative AI in the Enterprise with AMD Accelerators > High Performance LINPACK for Accelerator Introspection

High Performance LINPACK for Accelerator Introspection

  • High Performance LINPACK for Accelerator Introspection (HPL-MxP) is a benchmark that highlights the convergence of HPC and AI workloads by solving a system of linear equations using novel, mixed-precision algorithms. See https://hpl-mxp.org/ for more information about HPL-MxP and https://github.com/ROCm/rocHPL-MxP for compiling instructions and requirements.

    Run the following command to perform the benchmark on eight MI300X accelerators:

    ./mpirun_rochplmxp -P 4 -Q 2 -N 614400 --NB 2560

    The following table shows the performance results that are tested under ROCm 6.1.1. The results for MI300X per card are about 2.5 times faster than for the MI210 accelerator.

    Table 10.  HPL-MxP performance results

    Number of GPUs

    R750xa_MI210 (in GFLOPs)

    XE9680_MI300X (in GFLOPs)

    Speedup of MI300X over MI210

    1

    1.33E+05

    3.45E+05

    2.59

    2

    2.78E+05

    6.86E+05

    2.46

    4

    5.68E+05

    1.39E+06

    2.44

    8

    Did not run

    2.82E+06

    N/A