Data Science Blogs

Data Science Blogs#

Accelerate DeepSeek-R1 Inference: Integrate AITER into SGLang

Boost DeepSeek-R1 with AITER: Step-by-step SGLang integration for high-performance MoE, GEMM, and attention ops on AMD GPUs

May 16, 2025 by Bruce Xue, George Wang

Accelerated JPEG decoding on AMD Instinct™ GPUs with rocJPEG

Learn how to decompress JPEG files at breakneck speeds for your AI, vision, and content delivery workloads using rocJPEG and AMD Instinct GPUs.

May 12, 2025 by Marco Grond

Optimizing DeepseekV3 Inference on SGLang Using ROCm Profiling Tools

Dive into kernel-level profiling of DeepseekV3 on SGLang—identify GPU bottlenecks and boost large language model performance using ROCm

May 01, 2025 by Liz Li, Shekhar Pandey, Seungrok Jung, Andy Luo

Installing ROCm from source with Spack

Install ROCm and PyTorch from source using Spack. Learn how to optimize builds, manage dependencies, and streamline your GPU software stacks.

April 14, 2025 by Garrett Byrd, Joseph Schoonover

Applications & models

Seismic stencil codes - part 2

Seismic Stencil Codes - Part 2: In the previous post, recall that the kernel with stencil computation in the z-direction suffered from low effective bandwidth. This low performance comes from generating substantial amounts of data to movement to global memory.

August 29, 2024 by Justin Chang, Ossian O''Reilly

Seismic stencil codes - part 3

Seismic Stencil Codes - Part 3: In the last two blog posts, we developed a HIP kernel capable of computing high order finite differences commonly needed in seismic wave propagation.

August 29, 2024 by Justin Chang, Ossian O''Reilly