Posts by Gopal Muthukrishnan
Implementing a High-Performance Custom Diffusion Attention Kernel with FlyDSL
- 17 September 2026
Readers may be familiar with traditional Transformer models and their attention mechanisms. The traditional autoregressive transformers generate tokens iteratively. Since this feature significantly limits the inference throughput, researchers have begun exploring approaches such as diffusion models that can generate multiple tokens in each iteration.