Speculative Evaluation of Stochastic LLMs
Real-generation experiments that account for the pilot synchronization barrier show that HBN-async mitigates its overhead, helping translate statistical efficiency into practical evaluation benefits, and outperforming hindsight-tuned empirical and independent Bayesian baselines.
Qian-Li Shen, Xiang Li, Ruo-Meng Ding et al.
· 0 citations