Preprint
Oct 2026
On the Limits of Test-Time Compute for Self-Evaluation
Self-verification and aggregation have emerged as popular approaches for bridging the gap between pass@1 and pass@N. However, increasing the number of candidates does not consistently narrow the gap between final-answer accuracy and pass@N. To understand this limitation, we use ranking error to measure how reliably mod...
A. Buvanesh, Khaled Rouissi, Su-Jin Yun et al.
· 0 citations