Skip to content

Author

Ze-Yi Huang

We have 2 of 8 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

Trading Depth for Time in Recurrent Transformers

Recurrent Transformers increase computational depth through temporal recurrence, feeding each token's high-level hidden state into the computation of the next. This raises a natural question: is additional computation better spent on more temporal steps or greater physical depth? We investigate this question using Late...

Ze-Yi Huang, Xuehai He, Yong Jae Lee et al. · 0 citations

Latent Recurrent Transformer: Architecture Exploration, Training Strategies, and Scaling Behavior

Latent Recurrent Transformer is studied, a lightweight augmentation of autoregressive transformers that reuses a high-level source-layer hidden state from the previous token as recurrent memory for the next token, while retaining one-forward-per-token decoding with 9% latency overhead over the standard Transformer.

Zeyi Huang, Xuehai He, Liliang Ren et al. · 2 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.