Peng Sun

Peng Sun is Sr. Director of AI Software Development at AMD, overseeing the GPU AI software upper layers for ROCm. As one of the first engineers on ROCm, he has helped shape AMD’s AI software stack from inception to global deployment. Peng leads teams delivering AI frameworks, inference engines, and high-performance GPU operators for large-scale AI workloads. His work spans enabling industry-leading models, optimizing open-source AI software, and collaborating with major ecosystem partners. Holding a Ph.D. in Computer Science, Peng combines deep technical expertise with proven leadership in building scalable AI solutions that power cutting-edge research and enterprise AI applications worldwide. Peng’s linkedin profile: https://www.linkedin.com/in/pengsun86/

Posts by Peng Sun

The vLLM MoE Playbook: A Practical Guide to TP, DP, PP and Expert Parallelism

Learn how to combine TP, DP, PP, and EP for MoE models. Discover proven strategies to maximize performance on your vLLM deployments.

November 24, 2025 by Pin Siang Tan, Hongxia Yang, Peng Sun, Andy Luo, Jun Kang Chow, Ye Hur Cheong, Tun Jian Tan

Practical, Fault‑Robust Distributed Inference for DeepSeek on AMD MI300X

Learn how a small-radius expert parallel design with prefill–decode disaggregation enables scalable, fault-isolated LLM inference on AMD Instinct™ MI300X clusters.

November 12, 2025 by Peng Sun, Andy Luo, Gilbert Lei, Lingpeng Jin, Carlus Huang, Duyi Wang, Mingzhi Liu, Di Tian, Bill He, Jun Chen, Yutong Wu, Jiahao Zhou, Niko Ma

Empowering Developers to Build a Robust PyTorch Ecosystem on AMD ROCm™ with Better Insights and Monitoring

Production ROCm support for N-1 to N+1 PyTorch releases is in progress. The AI Software Head-Up Dashboard shows status of PyTorch on ROCm.

October 21, 2025 by Hongxia Yang, Peng Sun, Nick Romero, Jeff Daily, Jithun Nair, Pruthvi Madugundu, Jagadish Krishnamoorthy, Srinivasan Subramanian, Eli Uriegas

Matrix Core Programming on AMD CDNA™3 and CDNA™4 architecture

This blog post explains how to use Matrix Cores on CDNA3 and CDNA4 architecture, with a focus on low-precision data types such as FP16, FP8, and FP4

September 30, 2025 by Amanzhol Salykov, Andy Luo, Carlus Huang, Peng Sun

Accelerated LLM Inference on AMD Instinct™ GPUs with vLLM 0.9.x and ROCm

vLLM v0.9.x is here with major ROCm™ optimizations—boosting LLM performance, reducing latency, and expanding model support on AMD Instinct™ GPUs.

June 28, 2025 by Hongxia Yang, Peng Sun, Tun Jian Tan, Pin Siang Tan, Anshul Gupta

Unleash Full GPU Potential: Overlap Communication and Computation with Triton-Distributed

Unlock the full power of AMD GPUs—write portable, efficient kernels with Triton-Distributed, overlapping computation and communication with ease and flexibility

May 06, 2025 by Lei Zhang, George Wang, Fan Wu, Peng Sun, Kyle Wang, Anshul Gupta

Supercharge DeepSeek-R1 Inference on AMD Instinct MI300X

Learn how to optimize DeepSeek-R1 on AMD MI300X with SGLang, AITER kernels and hyperparameter tuning for up to 5× throughput and 60% lower latency over Nvidia H200

March 21, 2025 by Peng Sun, Andy Luo, Seungrok Jung, Liz Li, Hai Xiao