Chen Ding

CommuteProp: Decoupled Training for Communication Bound Split LLM Fine-Tuning

Split learning has emerged as a promising paradigm for privacy-preserving LLM fine-tuning, yet its practical deployment is severely hindered by the sequential communication-computation bottleneck. In conventional synchronous pipelines, clients remain idle while waiting for server-side gradients, resulting in substantia...