Recent Posts - Page 6#
Benchmarking Kimi-K3 Across vLLM, SGLang, and ATOM on MI350X
Learn how one declarative madengine command benchmarks day-0 Kimi-K3 across vLLM, SGLang, and ATOM on AMD Instinct MI350X.
Hyperloom: A Multi-Agent Harness for Autonomous Inference Optimization on AMD GPUs
Hyperloom is a multi-agent harness that autonomously optimizes LLM inference on AMD Instinct GPUs, reaching a median 1.73x throughput gain.
Serving GLM-5.2-MXFP4 on AMD Instinct™ MI355X: When Prefill Context Parallelism Pays
Learn when prefill context parallelism pays on AMD Instinct MI355X: 43-54% more throughput on long prompts with GLM-5.2-MXFP4, and when it loses.
Implementing a High-Performance Custom Diffusion Attention Kernel with FlyDSL
Learn how to implement and optimize flexible, high-performance diffusion attention kernels with FlyDSL.
Reproducing AMD MLPerf Inference v6.1 Submission Results
In this blog, we share the technical details of how we accomplish the results in our MLPerf Inference v6.1 submission.
Technical Dive into AMD MLPerf Inference v6.1 Submission
Learn about the ROCm optimizations powering dlrm-v3, llama2-70b, and gpt-oss-120b performance.
DFlash Speculative Decoding on AMD Instinct MI355X: Up to 5× Faster Qwen3.5 Inference
Explore how DFlash speculative decoding delivers up to 5× faster Qwen3.5 inference on AMD Instinct MI355X with vLLM on ROCm.
Thread Trace Part 1: ROCprof Compute Viewer
Learn to capture thread traces with rocprofv3 and analyze instruction timing, stalls, utilization, and counters in ROCprof Compute Viewer.
Knowledge Graph Integration With Poro2 For Enriching Medical Text Processing
Learn how to integrate a medical knowledge graph with Poro2 LLM via MCP to simplify medical text on AMD Instinct MI300X GPUs
An Educational GEMM Ladder for Helios GPUs
Build high-performance BF16 GEMM kernels on Helios GPUs with HipKittens, from a naive baseline to optimized schedules.
Iteratively Tuning hipBLASLt TensileLite Kernels: A Smaller Search, a Faster Kernel
Learn why a small iterative search beats a big one-shot sweep for hipBLASLt TensileLite kernels, in less time and with no risk of regression.
veRL on AMD: Production-Ready RL Post-Training on ROCm
Run veRL RL post-training on AMD Instinct GPUs with a turnkey ROCm container, AITER-accelerated rollout, and validated accuracy on MI300 and MI355.