Linear attention enables efficient long-context autoregressive decoding by compressing history into recurrent states, but this compression can make selective access to sparse and distant information difficult. Existing chunk-based extensions increase memory capacity, yet learned chunk-mixing coefficients may remain fix...
Zhuo-Kun Chen, Xi Lin, Xi-Yu Wu et al.· 0 citations
Long-horizon video world models require persistent memory to preserve scene consistency over extended rollouts. Softmax attention retains the full generation history through a growing KV cache, whereas recurrent linear attention compresses history into fixed-size states with substantially lower memory cost. However, we...
Zhuo-Kun Chen, Feng Chen, Xi Lin et al.· 0 citations
GrainGS is a dynamic Gaussian framework that combines a hierarchical anchor scaffold with per-Gaussian deformation that achieves high reconstruction quality, real-time novel view synthesis, and compact storage.