SWEPatchTest: Evaluating Software Tests Beyond Reproduction
Coding agents use generated tests to decide whether a proposed patch satisfies an issue's requirements. A suite that fails on the buggy program and passes after applying the reference patch can still accept an incorrect patch or reject a correct patch. We introduce SWEPATCHTEST, a test-generation benchmark with 619 tas...
Hua Lu, Peng-Cheng Wang, Han-Yu Li et al.
· 0 citations