Posts by Zihao Wang
Training EAGLE3 Speculative Decoding Draft Models on AMD Instinct MI350X with AMD Quark
- 27 October 2026
In a previous blog, we looked at the serving side of EAGLE3 speculative decoding for large language models on AMD Instinct™ GPUs: ROCm and vLLM backend enablement, and AMD Quark FP8 draft-model quantization. Serving is only half of the picture, though. Speculative decoding also depends on having a draft model worth serving. A serving stack can only accelerate a target model as far as the draft model allows.