A preliminary extension to coding tasks shows that SCOUT can support safety verification beyond computer-use, andlations and analysis show that tool-free rubric generation in SCOUT elicits substantially more reasoning and is crucial for safety detection across verifier backbones, especially non-frontier ones.
Jian-Xing Chen, Xiao Yu, Shipra Agrawal et al.· 0 citations
AppSim-Bench is proposed, which addresses this trade-off through controllable simulated apps that preserve task-relevant interaction logic while supporting deterministic evaluation and removes major sources of environmental stochasticity, enabling reproducible cross-model comparison.
Jin-Tian Feng, Long Chen, Xiao Yu et al.· 0 citations
The findings suggest world knowledge and task-directed ability can be learned in geometrically complementary forms, and that future post-training pipelines should consider how best to engineer the interface between them.
Rui-Ze Xu, Xiao Yu, Yu-Jin Tang et al.· 0 citations
These results show that current agents are still far from professional-level computer use: rather than stumbling on basic GUI control or coding, they lose track of constraints, miss information that arrives mid-task, guess rather than ask the user, and skip verification, struggling most when a task hinges on hidden sta...