Lei Zhang

Lei Zhang is an MTS Software Development Engineer on the Training at Scale team, driving scheduler efficiency and training stability for cloud-native training platforms at scale.

Posts by Lei Zhang

Resilient Large-Scale Training: Integrating TorchFT with TorchTitan on AMD GPUs

Achieve resilient, checkpoint-less distributed training on AMD GPUs by integrating TorchFT with TorchTitan on Primus-SaFE.

February 08, 2026 by Chaojun Hou, Lei Zhang, Lei Wei, Xiaofeng Zheng, Haishuo Kong, Jingxian Wang, Wen Xie, Liz Li, Yao Fu, Zhenyu Gu

Unleash Full GPU Potential: Overlap Communication and Computation with Triton-Distributed

Unlock the full power of AMD GPUs—write portable, efficient kernels with Triton-Distributed, overlapping computation and communication with ease and flexibility

May 06, 2025 by Lei Zhang, George Wang, Fan Wu, Peng Sun, Kyle Wang, Anshul Gupta