Reasoning Concentrates Errors, and Self-Consistency Never Notices
It is shown that reasoning concentrates a model's errors: the probability that two independently drawn wrong answers coincide rises in all ten dataset-scale comparisons, and in nine of nine after restricting both arms to the problems each gets wrong.