Skip to content

Author

Naoya Inoue

We have 2 of 16 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

Rethinking Contextualization by Reinterpreting Attention Head Channels

Contextualization, the core operation of language modeling, transmits information across words to build sentence-specific word representations. Prior works mainly study contextualization, focusing on individual words and attention heads as a growing discrete dictionary, lacking a global view of their general behavior....

Hakaze Cho, Hao-Lin Yang, Zhun Sun et al. · 0 citations
Preprint Aug 2026

Oilbird: Training-Free Speculative Decoding with Keys the Verifier Already Computes

A second, semantic draft source is proposed: the same pool, re-keyed by the hidden state the verifier has already computed at each committed token, together with a merge that lets it ride inside an existing lexical drafter's tree.

Tao Jin, P. Nguyen, Zhenzhu Yan et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.