Discrete visual tokenization, predominantly driven by vector, scalar, and product quantization, lacks a unified conceptual framework for understanding quantization tradeoffs. In this paper, we propose a unified rate--distortion perspective on modern discrete visual tokenization. By viewing quantization as lossy compres...
Xianghong Fang, Wenlong Mou, Yuan Yuan et al.· 0 citations
VQ-Transplant democratizes quantization research by enabling resource-efficient integration of novel VQ techniques while matching industry-level reconstruction performance.
Xianghong Fang, Yuan Yuan, Dehan Kong et al.· arXiv.org· 1 citation
Relay introduces a differentiable per-token channel that passes information between forward passes and is trained via truncated backpropagation through time (BPTT), demonstrating that state-of-the-art DLMs can be explicitly trained to relay latent information forward across decoding steps, advancing the performance-lat...
Benjamin Rozonoyer, Jacopo Minniti, Dhruvesh Patel et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.