HeteroFL-LoRA: Federated LoRA Fine-Tuning Across Heterogeneous LFMs via Singular Value Collaboration
HeteroFL-LoRA is proposed, a federated framework that enables LoRA fine-tuning across heterogeneous LFMs and introduces a Singular Matrix–Guided Subspace Projection that employs singular matrices to achieve cross-subspace mapping, enabling heterogeneous clients to aggregate their LoRA updates in a unified representatio...