Domain experts trained from a shared checkpoint can transfer their specialized capabilities to a single student through on-policy distillation (OPD). Existing research primarily focuses on improving this merging process, while the algorithms used to train the experts have received limited systematic comparison. We inve...
Jing-Yuan Huang, Zu-Ming Huang, Yu-Cheng Shi et al.· 0 citations
Domain experts trained from a shared checkpoint can transfer their specialized capabilities to a single student through on-policy distillation (OPD). Existing research primarily focuses on improving this merging process, while the algorithms used to train the experts have received limited systematic comparison. We inve...
Jing-Yuan Huang, Zu-Ming Huang, Yu-Cheng Shi et al.· 0 citations
An information-theoretic analysis is introduced, which decomposes next-item predictive information into three components: shared information, semantic-unique information, and collaborative-unique information, which proposes RIDRec, a novel role-aware sequential recommendation framework.
Jiang-Nan Xia, Yu Yang, Xiang Wang et al.· Knowledge Discovery and Data...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.