Posts by Gopal Muthukrishnan

Implementing a High-Performance Custom Diffusion Attention Kernel with FlyDSL

Readers may be familiar with traditional Transformer models and their attention mechanisms. The traditional autoregressive transformers generate tokens iteratively. Since this feature significantly limits the inference throughput, researchers have begun exploring approaches such as diffusion models that can generate multiple tokens in each iteration.

Read more ...