Ming-Sheng Pei

ROM: Real-time Overthinking Mitigation via Streaming Detection and Intervention

It is shown that the transition from productive to redundant reasoning is decodable from late-layer hidden states and representations separate the two phases around first-correct-solution boundaries beyond what position and lexical controls explain, and distinguish correct from incorrect solution endings.