Hung-Xuan Ho

SIGMA: Statistical Memory Head for Robust Class-Incremental Vision–Language Learning with CLIP

Class-incremental learning with vision–language models faces a fundamental tension: while CLIP provides strong zero-shot generalization, fine-tuning task-specific adapters induces representation drift and biases decision boundaries toward recent classes, leading to catastrophic forgetting. Freezing the CLIP backbone al...