The Reliability Wall : Why Scaling Cannot Buy Certifiable Compositional Reasoning, and Why It Is Permanent
Large language models are increasingly asked to perform tasks made of several dependent steps (multi-digit arithmetic, multi-step planning, rule-following, program synthesis) where the final answer is correct only if every one of those steps is correct; a single mistake anywhere invalidates the whole output. This paper...