Posts by Sean Song

Accelerate PyTorch Models using torch.compile on AMD GPUs with ROCm

11 July 2024

PyTorch 2.0 introduces torch.compile(), a tool to vastly accelerate PyTorch code and models. By converting PyTorch code into highly optimized kernels, torch.compile delivers substantial performance improvements with minimal changes to the existing codebase. This feature allows for precise optimization of individual functions, entire modules, and complex training loops, providing a versatile and powerful tool for enhancing computational efficiency.

Tags
AI/ML
C++
Compiler
Computer Vision
Diffusion Model
Fine-Tuning
GenAI
HPC
Installation
JAX
LLM
Linear Algebra
Memory
Multimodal
OpenMP
Optimization
Partner Applications
Performance
Profiling
PyTorch
Recommendation Systems
Reinforcement Learning
Scientific Computing
Serving
Speech
System-Tuning
TensorFlow
Tuning