On the Fundamental Limits of Prefill-Based Decoding Length Prediction
It is argued for a benchmarking protocol that fixes the model, data, and sampling parameters and that reports relative-error metrics alongside absolute ones, confirming that system error dominates model error.
Hao-Wen Shi, Xu-Zhe Yan, Fa-Hao Chen et al.
· 0 citations