Posts by Chelsea Iluno

Reproducing the AMD Instinct™ GPUs MLPerf Inference v5.1 Submission

• 09 September 2025
Meena Arunachalam , Miro Hodak , Poovaiah Palangappa , Wei-Ting Liao , Uma Kannikanti , Fulu Li , Karan Verma , Neha Mathews , Yamini Kamisetty , Chelsea Iluno , Ean Garvey , Kumar Deepak , Yixing Xu , Zhe Li , Guanchen Li , Xuanwu Yin , Dong Li , Clint Greene , Eliot Li
English
Applications & models
AI/ML GenAI Performance Optimization MLPerf Inference MLPerf

MLPerf Inference v5.1 marks AMD’s third round of submissions and the most ambitious yet. This round features submissions on AMD Instinct MI325X and MI355X systems, including multi-node inference and models in MXFP4 datatype. Building upon the success in MLPerf Inference v5.0, AMD has submitted improved results for Llama 2 70B and SDXL on the MI325X platform in this round using new optimization techniques. For a deeper look at these optimizations, see our Technical Dive into AMD’s MLPerf Inference v5.1 Submission. Additionally, explore how we optimized Llama 3.1 405B through pruning and fine-tuning in Slim Down Your Llama: Pruning & Fine-Tuning for Maximum Performance. In addition, AMD has made submissions for the following workloads:

Read more ...

---