Asynchronous flow map language models (aFMLMs), which incorporate prediction order into one-step modeling by learning the flow maps of asynchronous flows, are introduced, which can generate all tokens in a single forward pass by internalizing the ordering encoded in the flow into their hidden computations.
Chanhyuk Lee, Wonjung Kim, Patrick Pynadath et al.· 0 citations
Self-speculative decoding accelerates large language model (LLM) inference by drafting tokens from the target model itself, but faces a sharp tradeoff between the quality and cost of the draft. Early-exit methods produce drafts cheaply by terminating computation at intermediate layers, but forgo the deeper representati...
Han-Kun Lin, Patrick Pynadath, Ruqi Zhang· 0 citations
Simplax is introduced, an exact Dirichlet--categorical augmentation that couples each corrupted categorical state with an auxiliary simplex-valued variable while preserving the original uniform diffusion process as its categorical marginal.
Jinya Sakurai, Patrick Pynadath, Satoshi Hayakawa et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.