Shuai-Da He

What Should Federated LoRA Share? FedSAIL via Input-aware Subspace Alignment

This work introduces an input-aware action matrix that weights the adapter update by the second-moment statistics of local layer inputs and proposes Federated Subspace-Guided Action-Informed Learning (FedSAIL), which improves predictive performance over competing federated LoRA methods while reducing communication cost...