Iliya Mirzaei

Sample More, Reflect Less: Self-Refine and Reflexion Lose to Repeated Sampling at Equal Token Cost, from 1.5B to 7B

No method is reliably better than repeated sampling at equal cost anywhere, and ten are reliably worse, all of them methods where the model inspects its own output, and all 18 self-inspection comparisons are negative.