Posts tagged Triton

Two Waves, One Stage Apart: Warp-Pipelining Triton GEMMs on AMD Instinct

A tiled general matrix multiplication (GEMM) computes on one pair of operand tiles while preparing the next. On a compute-bound shape, keeping the matrix units busy depends on how well those activities overlap. A common failure mode is that resident waves reach synchronization points in phase: both prepare data or wait, and neither has matrix work ready to issue. Extra buffering creates room for future tiles, but does not by itself establish the execution timing needed to hide that preparation.

Read more ...


A Deep Dive into LDS Optimizations on AMD Instinct MI450 GPUs

The first two authors (Plavsic, Zaghen) contributed equally to this work.

Read more ...