D3D, a standalone diffusion drafter that removes inter-round dependency on target-model hidden states, combines blockwise denoising with auxiliary autoregressive supervision to achieve long accepted prefixes without target hidden states, enabling asynchronous speculative decoding.
Bao-You Chen, Rui-Qiao Mei, Guan-Cong Lin et al.· 0 citations
Long-horizon agents compact their history to continue within a finite context window, but a textual summary alone may not support every subsequent decision. We introduce REMORY, a neural memory network that supplements the summary with a bounded sequence of soft memory tokens. Given the history and summary, the network...
Han-Chen Xia, Bao-You Chen, Yu-Tang Ge et al.· 0 citations
This work studies online compaction across token eviction (TE) and attention matching (AM), adapting both to compact agent turns and comparing cheap proxy sources such as boundary, repeat-prefill, and delayed future-generation queries, finding TE is often more robust than AM under imperfect proxies.
Yujian Liu, Jiabao Ji, Li An et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.