Skip to content

Author

Ziheng Zhou

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#small language model Open access Sep 2026

Content-Addressed Recursive State: Resolving the DenseRetrieval Trade-o with a Cubic-Composition Readout

Recurrent architectures that compress history into a single state are cheap but have classically been unable to exactly retrieve far past key–value bindings, whereas attention content-addresses the whole past at quadratic cost. We show that the conflict between dense language modeling and long-range associative recall...

Ziheng Zhou · 0 citations
#small language model Open access Sep 2026

Content-Addressed Recursive State: Resolving the DenseRetrieval Trade-o with a Cubic-Composition Readout

Recurrent architectures that compress history into a single state are cheap but have classically been unable to exactly retrieve far past key–value bindings, whereas attention content-addresses the whole past at quadratic cost. We show that the conflict between dense language modeling and long-range associative recall...

Ziheng Zhou · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.