Think Wider: Mitigating Latent Rank Collapse in Implicit Chain-of-Thought Reasoning
WIDER is proposed, a lightweight spectral regularizer for implicit CoT that improves matched implicit CoT baselines, while mechanistic analyses reveal higher effective rank, lower dominant-direction energy, and reduced redundancy among latent steps.
Yuwen Hao, Meng-Lin Yang
· 0 citations