Aligning large language models (LLMs) with several objectives, such as helpfulness, harmlessness, and honesty, typically relies on preference judgment for each objective, growing the annotation cost linearly with the number of objectives. Active preference learning can reduce this cost by selecting the comparisons whos...
Duc Anh Vu, T. Nguyen, Hoang Pham et al.· 0 citations
Material replacement is a common interior-design operation: changing the material of a selected surface while preserving its geometry, surroundings, and illumination. Despite its commercial relevance, no public benchmark isolates this task, and evaluating it is challenging. Reference-based metrics penalize valid output...
Ming-Zhe Du, T. Nguyen, Nguyen Tran Cong Duy et al.· 0 citations
Comprehensive in-domain and out-of-domain evaluations across multiple LLMs demonstrate that SFS-DPO and SFS-DPO-R consistently outperform prior step-level training baselines and reveal improvements in self-correction frequency and effectiveness.
Duc Anh Vu, Nhat M. Hoang, Do-Xuan Long et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.