This position paper calls for household robots whose safety protections remain reliable beyond the situations, context, and history used to train and develop them, to achieve open-world safety.
Yu-Lin Tsai, Muxi Lyu, Roei Herzig et al.· 0 citations
TestJack is introduced, a scalable framework for evaluating patches beyond fixed tests that reveals a fundamental limitation of current coding-agent evaluation: as LLMs become better at optimizing against fixed evaluators, those evaluators themselves must become more adaptive.
Shuang-Jie Yao, Hao Wang, Koushik Sen et al.· 1 citation
Cross-Site Scripting (XSS) remains one of the most prevalent and damaging classes of web vulnerabilities. LLM-based coding agents offer a promising approach to XSS discovery by combining source-code reasoning with interactive testing against a running application. However, a coding agent's claims cannot be trusted on t...