ExecRetrieval: Measuring the Functional-Correctness Gap in Code-Embedding Retrieval
This work introduces ExecRetrieval, 939 Python tasks each paired with one execution-verified canonical implementation and up to four execution-verified buggy distractors, each generated by a mechanical mutation making a single targeted edit, and evaluates 23 dense embedding configurations plus BM25 under provider-nativ...