Posts by Zejun Chen
Keep the Agent Warm: How ATOM Serves AgentX Workloads on AMD Instinct MI355X GPUs
- 17 November 2026
A coding agent makes many model calls in one session, and each one re-sends almost everything before it: one recorded session makes 198 calls, and call #48 sends 195.5K tokens, only 1.3K of them new. Agentic workloads combine long shared histories and short outputs, interrupted by tool calls and parallel sub-agents. Serving them well takes more than raw GPU compute: it means keeping the agent warm, with its history cached and its decode moving when new requests arrive.
Optimizing ATOM and vLLM-ATOM for High-Interactivity Inference
- 01 September 2026
When you type a question into a chat assistant, ask a coding agent to make an edit, or watch tokens stream back from a model, what you feel is not throughput. You feel responsiveness. The pause before the first word appears, and the pace at which each following word arrives, decide whether an assistant feels instant or sluggish. As LLMs move into interactive assistants, coding agents, and multi-step tool-calling loops, this responsiveness — how quickly the system reacts to a single user — has become a first-class product requirement.
Scaling MiniMax-M3 Inference with Distributed Serving and Operator Co-Design on AMD Instinct MI355X GPUs
- 21 July 2026
This blog walks you through a set of MiniMax-M3 inference optimizations on AMD Instinct™ MI355X GPUs using ATOM, AITER, and ATOMesh. For broader background on the inference engine and distributed serving layers used here, see the ROCm blogs on ATOM and ATOMesh.
vLLM-ATOM: Unlocking Native AMD Performance in the vLLM Ecosystem
- 07 May 2026
This blog walks you through vLLM-ATOM, the AMD-optimized plugin that supercharges vLLM on Instinct GPUs.