SeMi-LoRA: Enhancing Low-Rank Adaptation via Separation and Mixing
This work proposes SeMi-LoRA (Separation and Mixing LoRA), a novel framework that enables complete high-rank updates while preserving mergeability and consistently outperforms strong PEFT baselines with favorable parameter efficiency.