Recent Posts - Page 4#
GEAK Agent-Driven Optimization of the DeepSeekV4 MLA Kernel
GEAK Agent accelerates DeepSeekV4 MLA kernel optimization with Triton and delivers SGLang E2E gains on AMD GPUs.
Serving NVFP4 Models on AMD Instinct™ MI355 Accelerators
Learn how to serve NVFP4 models on AMD Instinct™ MI355 using an emulation pipeline in vLLM — no format conversion needed.
QuickReduce INT3 Quantization and Benchmarking on MI355
Learn how QuickReduce uses INT3 quantization to accelerate all-reduce communication and evaluate its performance and accuracy on AMD Instinct MI355 GPUs.
Triton-Based Optimization of Video Sparse Attention on ROCm
Optimize video sparse attention on ROCm with GEAK and linear global context for faster, more stable video generation on AMD GPUs.
Fast Image Generation and Editing with SGLang Diffusion on AMD GPUs
Serve and benchmark diffusion models for image generation and editing on AMD Instinct GPUs using SGLang Diffusion on ROCm.
Porting High-Performance HIP Kernels to FlyDSL
This blog post shows how to port HIP C++ GPU kernels to FlyDSL, AMD's new Python DSL, matching hand-tuned C++ performance with less code.
AMD Instinct™ Network Traffic, Congestion Trends, and Harmonics in Scale-Out Networks for AI Training Clusters
Explore how synchronized GPU collectives create harmonic congestion in AI clusters and the strategies to diagnose and mitigate it.
SGLang-ATOM: Bring ROCm-Native Acceleration to SGLang Serving
Explore how SGLang-ATOM connects SGLang serving applications with ROCm-native ATOM execution to accelerate LLM inference on AMD Instinct GPUs.
Towards Feature Complete Triton Support in JAX-Triton
Learn what new features were added to JAX-Triton and how that could help you write or reuse more efficient and readable GPU kernels in JAX.
Efficient Hyperparameter Optimization for Autonomous Driving Models with AMD Instinct GPU Partitioning
Accelerate HPO for autonomous driving models using AMD MI300X GPU partitioning for higher throughput, efficiency, and parallelism.
Occupancy Math on the AMD MI355X GPU (CDNA4): A From-First-Principles Guide
Derive MI355X GPU (CDNA4) occupancy by hand: the four limiters, MXFP8 GEMM examples, and why matrix-bound kernels hit peak throughput at low occupancy.
RDC and RocProfiler Compared to DCGM for Commonly Used Metrics
Learn how CLI commands and Python code help you evaluate app performance without a profiler, with examples explaining what each metric means.