Verification strength does not buy discovery quality: a pre-registered, two-domain, hundred-pair test of verifier-bound automated research — Artifact Record
Oct 2026· Zenodo (CERN European Organization for Nuclear Research)
Abstract
Artifact record for the manuscript "Verification strength does not buy discovery quality: a pre-registered, two-domain, hundred-pair test of verifier-bound automated research". Contents: frozen pre-registration protocol (v1.0-v1.2 with changelogs), per-pair JSONL ledgers for two domains (job-shop scheduling, n=100 pairs; vehicular edge offloading on Beijing T-Drive, n=100 pairs), mutation-battery populations and scores, analysis scripts generating every number in the paper, exploratory pre-work probes, and the submitted manuscript. All quantitative results are generated by the released analysis scripts; none are hand-computed. Seed-to-figure reproduction: rerunning the scripts on the released ledgers reproduces every number and figure. Provenance: holdout instances evaluated exactly once per promoted rule (HoldoutGate, one-shot semantics). Three domain-D pairs (46, 71, 98) lack an S+ or S- promotion; the paired group contrast there is computed on the 97 valid pairs. Union-pool and tension-gradient analyses are exploratory (post-hoc) and labeled as such in the manuscript. License: code MIT; data and protocol CC-BY-4.0.
This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.
P. Abrahamsson, O. Salo, Jussi Ronkainen et al.· arXiv.org· 727 citations· ⚡54
The study shows that agile practices improve both informal and formal communication, but indicates that, in larger development situations involving multiple external stakeholders, a mismatch of adequate communication mechanisms can sometimes even hinder the communication.
M. Pikkarainen, Jukka Haikara, O. Salo et al.· Empirical Software Engineeri...· 401 citations· ⚡48
The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.
Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al.· Information and Software Tec...· 394 citations· ⚡54
The perception of the impact of agile methods is predominantly positive, and several challenge areas were discovered, but based on this study, agile methods are here to stay.
M. Laanti, O. Salo, P. Abrahamsson· Information and Software Tec...· 260 citations· ⚡20
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 15, 2026
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Microsoft Research Blog· microsoft.comOct 15, 2026
Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduOct 8, 2026