Posts by Diwakar Das
Accelerating GLM-5.2 on AMD Instinct MI355X: EvalScope Benchmarks with Prefix Caching
- 11 November 2026
GLM-5.2 combines a large Mixture-of-Experts (MoE) architecture, sparse attention, and long-context processing. At long input lengths, this combination creates bottlenecks across GPU compute, memory bandwidth, and inter-GPU communication. Tuning a single kernel is not enough; the parallelization strategy, KV-cache layout, collective communication, kernels, and serving framework must be optimized together.