Preprint
Aug 2026
Allocating Recurrent Compute in Looped Language Models
Results show that the benefits of recurrent depth can be retained without repeatedly executing the dense FFN, and view recurrence as repeated composition of a state update and argue that an application is valuable when it exposes a new cross-position influence direction that remains observable at the task readout.
Ruhai Lin, Yi Guo, Ruiming Zhu et al.
· 0 citations