Lei Zhang

Lei Zhang is an MTS Software Development Engineer on the Training at Scale team, driving scheduler efficiency and training stability for cloud-native training platforms at scale.

Posts by Lei Zhang

February 08, 2026

Resilient Large-Scale Training: Integrating TorchFT with TorchTitan on AMD GPUs

Achieve resilient, checkpoint-less distributed training on AMD GPUs by integrating TorchFT with TorchTitan on Primus-SaFE.

https://rocm.blogs.amd.com/artificial-intelligence/primus-torchft/README.html

May 06, 2025

Unleash Full GPU Potential: Overlap Communication and Computation with Triton-Distributed

Unlock the full power of AMD GPUs—write portable, efficient kernels with Triton-Distributed, overlapping computation and communication with ease and flexibility

https://rocm.blogs.amd.com/software-tools-optimization/triton-distributed-c/README.html