Posts by Yu Zhou

hipBLASLt Online GEMM Tuning

• 19 March 2026
Han Lin , Yu Zhou , Spandan Tiwari , Xinjun Niu , Chao Li , Wei Luo , Zhou Yu , Ashish Sirasao
English
Applications & models
Performance hipBLASLt LLM GEMM Tuning

This blog post introduces the integration of hipBLASLt Online GEMM Tuning into LLM frameworks, illustrated through an example implementation of RTP-LLM. Developed by the AMD Quark Team, hipBLASLt Online Tuning provides a user-friendly approach to improving GEMM performance by enabling runtime tuning without requiring additional offline tuning steps.

Read more ...

---