Skip to main content

Ctrl+K

ROCm™ Blogs

GitHub
Community
Documentation
Infinity Hub
Support

ROCm blogs

Ctrl+K

Recent Posts

13 November - SGLang: Fast Serving Framework for Large Language and Vision-Language Models on AMD GPUs
13 November - Quantized 8-bit LLM training and inference using bitsandbytes on AMD GPUs
13 November - Introducing AMD’s Next-Gen Fortran Compiler
01 November - Distributed Data Parallel Training on AMD GPU with ROCm
24 October - Torchtune on AMD GPUs How-To Guide: Fine-tuning and Scaling LLMs with Multi-GPU Power

Tags

AI/ML
C++
Compiler
Computer Vision
Diffusion Model
Fine-Tuning
GenAI
HPC
Installation
JAX
LLM
Linear Algebra
Memory
Multimodal
OpenMP
Optimization
Partner Applications
Performance
Profiling
PyTorch
Recommendation Systems
Reinforcement Learning
Scientific Computing
Serving
Speech
System-Tuning
TensorFlow
Time Series
Tuning

Categories

Applications & models (85)
Ecosystems and Partners (5)
Software tools & optimizations (18)

Archives

2024 (95)
2023 (11)
2022 (2)

Posts by...

Posts by Seungrok Jung

Large language model inference optimizations on AMD GPUs

15 March 2024

Seungrok Jung

English

Applications & models

LLM AI/ML GenAI Fine-Tuning

15, Mar 2024 by Seungrok Jung.

Read more ...

Terms and Conditions
Privacy
Trademarks
Statement on Forced Labor
Fair and Open Competition
UK Tax Strategy
Cookie Policy
Cookie Settings

© 2024 Advanced Micro Devices, Inc