Jerry Adams Franklin

Adaptive Phase-Switching for Communication-Efficient Federated LoRA Fine-Tuning

Federated fine-tuning of large language models with low-rank adaptation reduces per-client trainable parameters, but client-to-server communication remains the dominant cost. Existing accounting for federated LoRA protocols omits the asymmetric transition round when a protocol changes aggregation mode, and reports savi...