WebCraftBench, an interactive benchmark for evaluating web application generation from a software testing perspective, is proposed and experiments show that coverage guidance improves exploration coverage and the model rankings remain stable when the judge model is replaced.
This work proposes DualViewEval, an agent benchmark compression method that jointly exploits outcome and process relations to learn an exact-size miniset and predict the full-benchmark scores, and achieves the best results in all datasets.
Xin-Shuai Guo, Jun-Jie Wu, Dolly Deng et al.· 0 citations
Human evaluation provides a direct measure of the quality of LLM-generated web applications. However, fitting human judgments through automated evaluation remains challenging. Static benchmarks can credit functionality that exists in source code but is unreachable at runtime. Interactive benchmarks exercise the applica...
Chen-Xu Liu, Zi-Lu Zou, Pei-Zhong Gao et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.