Social Gym is introduced, an environment of 21 multi-agent social games whose rule-decided outcomes make agent performance verifiable and objective, and SPaRTan (Self-Play and Reflect-Transfer), a training-free self-improvement loop that offers a reproducible, verifiable foundation for measuring and improving LLM socia...
The need to develop translation technologies that directly serve translators' needs rather than replacing human translation can be done by focusing more on the assistive tools that emphasize the uncertain, social, and ultimately human character of translation, rather than automation.
Daniel Chechelnitsky, Sireesh Gururaja, Seyi Olojo et al.· Proceedings of the AAAI/ACM...· 0 citations
CarryOnBench is introduced, the first interactive benchmark that measures whether LLMs can revise their interpretation of user intent and recover utility, while remaining safe through multi-turn conversations, and Ben-Util, a checklist-based metric that evaluates how well each model response fulfills the user's benign...
A systematic audit of LLM-based social simulations across four databases found that reported collective phenomena often vanish or reverse once PIMMUR principles are enforced, indicating that many"emergent"behaviors are methodological artifacts rather than genuine social dynamics.
It is shown that LLM-as-judge RL induces reward-hacking patterns, and that LLM-as-judge RL detectors can mitigate them during post-training, suggesting that behavioral foundation models require rethinking the LLM training paradigm.
Xuhui Zhou, Weiwei Sun, Weihua Du et al.· arXiv.org· 8 citations· ⚡1
An evaluation paradigm that assesses model responses along three criteria grounded in cooperative response theory is designed, suggesting pragmatic redirection is a fundamentally underdeveloped capability in current LLMs.
Akhila Yerukola, Jena D. Hwang, Ming-Qian Zheng et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
