Ctrl+K

AI - Software Tools & Optimizations - Page 5

AI - Software Tools & Optimizations - Page 5#

SGLang: Fast Serving Framework for Large Language and Vision-Language Models on AMD Instinct GPUs

Discover SGLang, a fast serving framework designed for large language and vision-language models on AMD GPUs, supporting efficient runtime and a flexible programming interface.

November 13, 2024 by Michael Zhang, Hai Xiao, Hui Liu, Yineng Zhang

TensorFlow Profiler in practice: Optimizing TensorFlow models on AMD GPUs

TensorFlow Profiler measures resource use and performance of models, helping identify bottlenecks for optimization. This blog demonstrates the use of the TensorFlow Profiler tool on AMD hardware.

June 18, 2024 by Fabricio Flores

SmoothQuant model inference on AMD Instinct MI300X using Composable Kernel

SmoothQuant model inference on AMD Instinct MI300X using Composable Kernel

May 31, 2024 by Cheng Ling

Creating a PyTorch/TensorFlow code environment on AMD GPUs

Creating a PyTorch TensorFlow environment on AMD GPUs

September 11, 2023 by Yao Fehlis