Next Thoughts Are Distributions: Generative Autoregressive Reasoning in the Latent Space
Autoregressive Thought Flow is introduced, which models the next continuous thought as a multimodal distribution, and suggests that continuous reasoning is more effective when multiple possible next thoughts remain available rather than being collapsed into a single prediction.