Skip to main content

Ctrl+K

ROCm™ Blogs

GitHub
Community
Documentation
Infinity Hub
Support

ROCm blogs

Ctrl+K

Recent Posts

10 December - Training Transformers and Hybrid models on AMD Instinct MI300X Accelerators
03 December - Transformer based Encoder-Decoder models for image-captioning on AMD GPUs
13 November - SGLang: Fast Serving Framework for Large Language and Vision-Language Models on AMD Instinct GPUs
13 November - Quantized 8-bit LLM training and inference using bitsandbytes on AMD GPUs
13 November - Introducing AMD’s Next-Gen Fortran Compiler

Tags

AI/ML
C++
Compiler
Computer Vision
Diffusion Model
Fine-Tuning
GenAI
HPC
Installation
JAX
LLM
Linear Algebra
Memory
Multimodal
OpenMP
Optimization
Partner Applications
Performance
Profiling
PyTorch
Recommendation Systems
Reinforcement Learning
Scientific Computing
Serving
Speech
System-Tuning
TensorFlow
Time Series
Tuning

Categories

Applications & models (86)
Ecosystems and Partners (6)
Software tools & optimizations (18)

Archives

2024 (97)
2023 (11)
2022 (2)

Posts by...

Posts by Seungrok Jung

Large language model inference optimizations on AMD GPUs

15 March 2024

Seungrok Jung

English

Applications & models

LLM AI/ML GenAI Fine-Tuning

15, Mar 2024 by Seungrok Jung.

Read more ...

Terms and Conditions
Privacy
Trademarks
Statement on Forced Labor
Fair and Open Competition
UK Tax Strategy
Cookie Policy
Cookie Settings

© 2024 Advanced Micro Devices, Inc