Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
MLPerf™ Inference v2.1 with NVIDIA GPU-Based Benchmarks on Dell PowerEdge Servers
Introduction What is new in MLPerf Inference v2.1? Growth of MLPerf Inference as a benchmark Dell results Notable results Highlighting performance scores System performance details PowerEdge server, GPU, and Software specifications
PowerEdge servers
GPUs
NVIDIA tools
Performance improvements Conclusion and Key Takeaways Acknowledgment References

NVIDIA tools

NVIDIA tools

  • Tensor RT

    NVIDIA TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

    Triton Inference Server

    Triton Inference Server, part of the NVIDIA AI platform, streamlines AI inference by enabling teams to deploy, run, and scale trained AI models from any framework on any GPU- or CPU-based infrastructure. It provides AI researchers and data scientists the freedom to choose the right framework for their projects without impacting production deployment. It also helps developers deliver high-performance inference across cloud, on-premises, edge, and embedded devices.