Continual learning (CL) aims to incrementally acquire knowledge from sequential data while avoiding catastrophic forgetting. Recently, prompt tuning has attracted increasing attention as an efficient approach for adapting pre-trained models to CL tasks. However, existing prompt design paradigms commonly suffer from ret...
Yun-Fei Zhang, Wen Wen, Tie-Liang Gong et al.· 0 citations
Plasticity loss has emerged as a critical challenge in continual learning that significantly hinders the acquisition of sequential tasks. While optimizing activation designs offers a potential solution, current fixed-form functions suffer from an inherent spectral bias towards low-frequency variations, whereas learnabl...
Zeyang Zhang, Tie-Liang Gong, Junyan Lu et al.· 0 citations
This work decomposes the expected generalization gap into a replay-induced representation drift and an optimization-dependence term, the latter further resolved into stability, plasticity, interaction, and residual-coupling components and develops a layer-wise information-theoretic framework that separates these effect...
Tie-Liang Gong, Zhong-Bo Zhang, Wen Wen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.