Software tools & optimizations - Page 2#
Discover the latest blogs about ROCm software tools, libraries, and performance optimizations to help you get the most out of your AMD hardware.
Memory Instruction Scheduling for Lock-Stepped Kernels on AMD Instinct™ MI300X: Introducing the Series
Explore how instruction scheduling eases stalls on AMD Instinct MI300X in a new blog series. This intro covers the motivating example and methodology.
Bring Claude Code On‑Prem with AMD Instinct GPUs
Start running Claude Code securely with a self-hosted SGLang LLM on AMD Instinct MI355X GPUs.
Production-Ready MXFP4 Online Rotation with Fused Kernels on AMD Instinct™ MI355X
Learn how fused Gluon (Triton) kernels cut MXFP4 online-rotation overhead to near-zero on AMD Instinct MI355X, making it production-ready.
Using ODC to Accelerate AMD SFT Training
Learn how we ported ODC on-demand P2P communication to AMD Instinct MI300X to cut FSDP bubbles and speed up variable-length SFT training.
Closing the GPU Cluster Validation Gap: A Kubernetes-Native Approach with CVF
Learn how to validate AMD GPU clusters end-to-end with CVF: hardware acceptance, mesh bandwidth, RDMA, and RCCL testing in one pipeline.
AMD GPU Operator v1.5.0: DRA Support, Automated GPU Node Recovery, and Expanded Kubernetes Infrastructure Control
Discover how AMD GPU Operator v1.5.0 improves GPU scheduling, automates node recovery, and expands Kubernetes control.
Attention Decode on AMD MI450 GPUs: A Gluon Kernel Optimization Guide
Learn how to design a high-performance attention decode kernel on AMD MI450 GPUs using Gluon.
Serve Kimi-K2.5-MXFP4 on MI355X with ATOM
Serve Kimi-K2.5-MXFP4 on MI355X with ATOM and gfx950 block-scaled FP4 kernels for optimized LLM inference.
Hyperloom - Autonomous Agentic Inference Optimization for AMD GPUs
Hyperloom is a new open-source, agentic system aimed at automating the time-consuming task of optimizing end-to-end inference workloads.
Introducing AMD ROCm™ Infera: Scaling Goodput for Agentic AI with Distributed Inference Orchestration
Explore how AMD ROCm Infera orchestrates distributed inference to scale goodput for agentic AI on AMD Instinct GPUs.
Spur: Modern GPU Job Scheduling for HPC and AI Workloads
Explore how Spur addresses pain points in GPU cluster management and how Spur-Cloud extends the platform into a complete GPU-as-a-Service solution.
Deploy an Imaging AMD Solution Blueprint on AMD Radeon™ GPUs
Learn how to deploy AMD Solution Blueprints on AMD Radeon™ GPUs by following a hands-on example of deploying the MRI Analysis Tool Solution Blueprint