AIMS, a human-annotated dataset of 1,724 difficult safety prompts, is introduced to evaluate intent-aware training across supervised fine-tuning, preference learning, reasoning distillation, and reinforcement learning and shows that faithful intent modeling is a compact, high-quality supervision signal for more robust...
J. Ferrao, Niclas Müller-Hof, Iustin Sîrbu et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.