OPSRD: On-Policy Self-Role Distillation
Role prompting elicits specialized behavior from large language models through an expert identity, offering a lightweight way to guide reasoning on demanding tasks. However, evaluating or distilling complete role-prompted answers can miss useful next-token preferences when the sampled solution remains incorrect. Transf...
Wei-Jie Ren, Yan-Wen Zhang, Hao Li et al.
· 0 citations