This work introduces CUA-Master, a nested double-loop recursive improvement framework that substantially improves the quality and efficiency of data synthesis, and exhibits continuous gains across recursive iterations.
GUI agents require high-quality interaction trajectories to learn how software environments respond to actions, maintain state, and support multi-step workflows. However, the diversity of available trajectories is constrained by the applications, interface states, and workflows accessible in the underlying environments...
Cheng Yang, Yi-Fan Wu, Yu Huang et al.· 2 citations
UI2App is the first benchmark targeting interaction inference, the ability to recover application behavior from screenshots alone, without any textual or behavioral guidance, and designs an end-to-end pipeline that evaluates each artifact along four dimensions: executability, navigation reachability, visual fidelity, a...
Grace Man Chen, Litao Guo, Yifan Wu et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.