AI - Software Tools & Optimizations - Page 2#
Bringing Ultra-Fast, Interactive LLM Inference to AMD Instinct™ MI355X GPUs
Accelerate single-request LLM inference on AMD Instinct MI355X with megakernels, speculative decoding, and MXFP4 for 1.9-3.3x faster decode.
AMD Instinct MI455X vs MI355X: A Technical Look at the Advancing AI 2026 Inference Numbers
Explore the MI455X vs MI355X inference numbers from Advancing AI 2026, and learn how each benchmark was measured and what it really means.
DI Series: Serving Kimi-K3 MXFP4 Wide-EP Disaggregated on AMD Instinct MI300X and MI325X
Learn how to serve a 1.4 TiB Kimi-K3 MXFP4 mixture-of-experts model disaggregated across AMD Instinct MI300X and MI325X GPUs.
Automating Performance Bottleneck Identification with the TraceLens Agent
TraceLens Agent is an agentic workflow that examines GPU traces to deliver a prioritized optimization report, detailing root causes and fixes.
UltraQuant on AMD Instinct: More Efficient Agentic Serving for Qwen3.8-MXFP4
A native 4-bit MXFP4 KV cache that speeds up Qwen3.8 decode over 8-bit KV on AMD Instinct MI355X, with no accuracy loss.
Debugging Logprob Mismatches in LLM Reinforcement Learning
Learn to debug logprob mismatches between rollout and training with Qwen3 examples on AMD Instinct MI355X GPUs.
Hyperloom: A Multi-Agent Harness for Autonomous Inference Optimization on AMD GPUs
Hyperloom is a multi-agent harness that autonomously optimizes LLM inference on AMD Instinct GPUs, reaching a median 1.73x throughput gain.
Implementing a High-Performance Custom Diffusion Attention Kernel with FlyDSL
Learn how to implement and optimize flexible, high-performance diffusion attention kernels with FlyDSL.
An Educational GEMM Ladder for Helios GPUs
Build high-performance BF16 GEMM kernels on Helios GPUs with HipKittens, from a naive baseline to optimized schedules.
Iteratively Tuning hipBLASLt TensileLite Kernels: A Smaller Search, a Faster Kernel
Learn why a small iterative search beats a big one-shot sweep for hipBLASLt TensileLite kernels, in less time and with no risk of regression.
veRL on AMD: Production-Ready RL Post-Training on ROCm
Run veRL RL post-training on AMD Instinct GPUs with a turnkey ROCm container, AITER-accelerated rollout, and validated accuracy on MI300 and MI355.
Efficiently Serving NVFP4 Models on AMD Instinct™ MI350X/MI355X Accelerators via Online NVFP4 to Quark MXFP4 Requantization
Serve NVFP4 models on MI350X/MI355X via SGLang's online NVFP4 to MXFP4 requantization: no preprocessing, minimal accuracy impact, native throughput.