Align Before Aggregation: Basis-Consistent Federated LoRA under Heterogeneous Ranks
The theoretical analysis clarifies the role of basis consistency and supports the proposed consistency-aware aggregation mechanism, FedAbA, which is proposed as a basis-consistent federated LoRA aggregation framework for heterogeneous ranks.
Peng-Peng Qiao, Yang Cao, Ling-Ling Zhang et al.
· 0 citations