TL;DR
ViMSUIT is presented, an autonomous testing framework that bridges the gap between visual intent and executable script generation by leveraging the synergistic reasoning of Vision Language Models (VLMs) and Large Language Models (LLMs).
A key challenge for multimodal large language models (MLLMs) is moving beyond visual recognition to constraint-aware cross-modal reasoning. This involves combining visual cues with information from other modalities to understand elements'relationships under domain-specific rules. This challenge is acutely evident in in...
SchemaGUI, a template-based benchmark for controllable GUI generation evaluation, synthesizing paired natural language instructions and deterministic function-call references from parameterized interface schemas can generate thousands of deterministically annotated tasks in seconds without human labeling.
ProgramDistill is introduced, a benchmark evaluating coding agents on features discovered through interaction with fully functional reference applications, and provides a scalable benchmark with controlled difficulty for evaluating and diagnosing coding agents, and a natural basis for future curriculum-based training.
A reproducible, human-validated evaluation framework applied to 13 strategies—four architectural families crossed with four reasoning variants crossed with four reasoning variants—across three SLMs spanning 3B–14B parameters, plus targeted ablations.
Software testing is a crucial process in software development. Despite its importance, the software testing process is often time-consuming and inconsistent when performed manually. With the rapid development of Large Language Models (LLMs), software testing processes such as generating test cases have utilized LLMs. N...
UI-Venus-2 is presented, a general-purpose foundation GUI agent designed to operate across mobile, web, and desktop environments through a unified closed-loop reasoning-action framework that integrates safety-aware mechanisms to ensure controlled execution of consequential actions.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
