Skip to main content

Ctrl+K

ROCm™ Blogs

GitHub
Community
Documentation
Infinity Hub
Support

ROCm blogs

Ctrl+K

Recent Posts

01 November - Distributed Data Parallel training on AMD GPU with ROCm
24 October - Torchtune on AMD GPUs How-To Guide: Fine-tuning and Scaling LLMs with Multi-GPU Power
24 October - CTranslate2: Efficient Inference with Transformer Models on AMD GPUs
23 October - Inference with Llama 3.2 Vision LLMs on AMD GPUs Using ROCm
15 October - Speed Up Text Generation with Speculative Sampling on AMD GPUs

Tags

AI/ML
C++
Compiler
Computer Vision
Diffusion Model
Fine-Tuning
GenAI
HPC
Installation
JAX
LLM
Linear Algebra
Memory
Multimodal
OpenMP
Optimization
Partner Applications
Performance
Profiling
PyTorch
Recommendation Systems
Reinforcement Learning
Scientific Computing
Serving
Speech
System-Tuning
TensorFlow
Time Series
Tuning

Categories

Applications & models (81)
Ecosystems and Partners (4)
Software tools & optimizations (17)

Archives

2024 (89)
2023 (11)
2022 (2)

Posts by...

Posts by Seungrok Jung

Large language model inference optimizations on AMD GPUs

15 March 2024

Seungrok Jung

English

Applications & models

LLM AI/ML GenAI Fine-Tuning

15, Mar 2024 by Seungrok Jung.

Read more ...

Terms and Conditions
Privacy
Trademarks
Statement on Forced Labor
Fair and Open Competition
UK Tax Strategy
Cookie Policy
Cookie Settings

© 2024 Advanced Micro Devices, Inc