When Longer Rationales Fail To Help A Small Model Solve Hard Problems
Chain-of-thought distillation can improve the reasoning ability of small language models, yet it remains unclear whether harder problems should receive longer rationales. We investigate this assumption using 5,383 paired MATH training problems, each containing both a short and a long rationale. A difficulty-aware polic...