#machine learning
Sep 2026
Mentored Decoding: Faster Inference meets Boosting
This paper formally proves how such a feat is possible with a formal approach to lossy speculative decoding called mentored decoding, and uncovers key properties of mentored decoding, among which the particularly appealing geometric nature of the total variation case.
Vivien Tran-Thien, Richard Nock
· arXiv.org · 0 citations