Tian-Hao Li

CAMR: Compatibility-Aware Memory Replay for Continual Learning in Large Language Models

Continual learning requires large language models to acquire new knowledge and capabilities while retaining what they have learned. Fine-tuning and replay support acquisition and retention, but deciding whether incoming examples need supervision and which historical examples to revisit remains a challenge. We propose C...