Taehyeong Kwon

PRISM-LoRA: Principal-Direction-Guided Single-LoRA Merging Framework for Continual Learning of Large Language Models

PRISM-LoRA is proposed, a replay-free framework that repeatedly trains a single LoRA module, merges its update into the backbone, and reinitializes it for the next task, unlike LoRA-based continual-learning approaches that retain task-specific modules or allocate separate task-specific learning spaces.