Ctrl+K

Software tools & optimizations - Data Science Blogs

Software tools & optimizations - Data Science Blogs#

Explore the latest blogs about applications and models in the ROCm ecosystem, including machine learning frameworks, AI models, and application case studies.

Optimizing DeepseekV3 Inference on SGLang Using ROCm Profiling Tools

Dive into kernel-level profiling of DeepseekV3 on SGLang—identify GPU bottlenecks and boost large language model performance using ROCm

May 01, 2025 by Liz Li, Shekhar Pandey, Seungrok Jung, Andy Luo

Installing ROCm from source with Spack

Install ROCm and PyTorch from source using Spack. Learn how to optimize builds, manage dependencies, and streamline your GPU software stacks.

April 14, 2025 by Garrett Byrd, Joseph Schoonover

Understanding RCCL Bandwidth and xGMI Performance on AMD Instinct™ MI300X

The blog explains the reasons behind RCCL bandwidth limitations and xGMI performance constraints, and provides actionable steps to maximize link efficiency on AMD MI300X

March 02, 2025 by Jayacharan Kolla, Pedram Alizadeh, Gilbert Lee

SmoothQuant model inference on AMD Instinct MI300X using Composable Kernel

SmoothQuant model inference on AMD Instinct MI300X using Composable Kernel

May 31, 2024 by Cheng Ling

Application portability with HIP

Application portability with HIP

April 26, 2024 by Suyash Tandon, Maria Ruiz Varela, Gina Sitaraman, Bob Robey

Register pressure in AMD CDNA™2 GPUs

Register pressure

May 17, 2023 by Alessandro Fanfarillo, Nicholas Curtis

AMD matrix cores

Matrix cores

November 14, 2022 by Gina Sitaraman, Damon McDougall, Rene Van Oostrum, Nicholas Malaya, Noel Chalmers, Ossian O''Reilly