Well-Specified and Well-Tested? Assessing SWE-bench-Style Datasets with a Self-Evolving Agent
ExLabel is proposed, an LLM-based, self-evolving, experience-guided assistant for task clarity and test coverage assessment in SWE datasets that maintains an evolving experience bank that distills cross-instance knowledge into stable yet adaptive judgment criteria and reuses relevant experience to guide the assessment...
Zhong-Hao Jiang, Xu-Yang Zheng, Yan-Fu Yan et al.
· 0 citations