Mario Sanger

Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability

Chain-of-thought (CoT) reasoning allows humans to inspect how large language models reach their answers, and oversee model behaviour. This reasoning comes at an increased inference cost, motivating efficient methods that train models to solve tasks using fewer tokens. However, a common concern is that such training may...