SPACE-LoRA: Allocating Activation-Subspace Protection for Continual Learning
This study addresses the catastrophic forgetting problem that occurs when sequentially learning successive tasks using Low-Rank Adaptation (LoRA) from a lifelong learning perspective and proposes Subspace Protection with Allocated Capacity for Efficient Continual Adaptation (SPACE-LoRA).
Seunghyun Yoo, Kiseok Kim, Hyeontae Joo et al.
· 0 citations