Posts by Aditya Nandakumar
Bringing Ultra-Fast, Interactive LLM Inference to AMD Instinct™ MI355X GPUs
- 20 October 2026
AI inference is no longer just a throughput problem. As reasoning models, AI agents and interactive applications become mainstream, responsiveness has become a first-class metric. Users notice seconds, not tokens per second. Lowering time per output token (TPOT) is now critical for AI systems that feel conversational, responsive and useful.