We have 3 of 17 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
LoLBench is a multilingual benchmark of 100 tasks across 29 software systems in five domains that shows that both perception and implementation remain central challenges for coding agents in practical modular development on large software systems.
TraceProbe is presented, a trajectory-diagnostic framework that recovers what resolve rate hides and adds auditable diagnostic context to outcomes by localizing inspection targets, suggesting failure hypotheses, and prioritizing runs for review.
SWE-RPG is introduced, a repository-level benchmark that combines executable patch evaluation with validated ground-truth references (GTs) for Requirement Clarification and Implementation Planning, and suggests implicit-requirement recovery as a key candidate direction for improving coding agents.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
