Large language model (LLM) agents are rapidly reshaping software engineering, accompanied by an explosion of new code benchmarks. Yet nearly all existing benchmarks still rely on the same decades-old criterion: a solution is correct if it passes a fixed set of unit tests. Such tests are often insufficient: they check o...
Shuang-Jie Yao, Hao Wang, Koushik Sen et al.· 0 citations
Program verification establishes software correctness through machine-checkable proofs constructed in theorem provers. It's a guarantee especially valuable for code generated by large language models (LLMs), which is fluent but carries no assurance of correctness. Almost all existing provers, however, pursue pass rates...
Shuang-Jie Yao, Nikolaus Holzer, Mark Santolucito et al.· 0 citations
This work proposes a novel defense that recovers necessary information needed to distinguish valid from invalid cache hits from the raw text of the cache key, and proves that Deletion Gain stays positive when a deletion leaves text close enough to the rewrite, and searches for such deletions with a sliding window.
Zi-Han Zhang, Shuang-Jie Yao, Ze-Sen Liu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.