Wen-Xuan Shi

On the Reliability of LLM-Based Vulnerability Patching Benchmarks

Large language models (LLMs) have shown strong potential for automated vulnerability patching, but current benchmarks can substantially distort reported performance. Drawing on extensive experience developing, running, and stress-testing such frameworks, we identify under-examined pitfalls across three dimensions: (1)...