We study sparse and continual reinforcement learning fine-tuning of language models through attention-head ranking and partitioning. For sparse learning, we rank attention heads by gradient norm to identify a small subset of heads that can be trained effectively. For continual learning, we partition heads across tasks...
Rui-Zhe Shi, Zai-Wen Yang, Qiu-Bo Wang et al.· 0 citations
This review surveys system identification for complex dynamical systems through a unified framework that connects model structure, operating mode, estimation target, and computational setting and identifies key open challenges, including robust identification under biased or limited data, uncertainty-aware modeling, in...
Xiaoyu Zhang, Zi-Qiang Li, Ruizhe Shi et al.· Complex Engineering Systems· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.