Conference
Open access
Sep 2026
SeMi-LoRA: Enhancing Low-Rank Adaptation via Separation and Mixing
This work proposes SeMi-LoRA (Separation and Mixing LoRA), a novel framework that enables complete high-rank updates while preserving mergeability and consistently outperforms strong PEFT baselines with favorable parameter efficiency.
Zhen-Fei Yang, Beiming Yu, Peiqin Lin et al.
· Proceedings of the Thirty-Fi... · 0 citations