Skip to content

Author

Heng Huang

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Towards Optimal Multi-draft Speculative Decoding

The results show that the draft sampling method strongly influences the optimal acceptance rate, with sampling without replacement outperforming sampling with replacement, and the theoretical upper bound of MDSD efficiency is measured for the first time.

Zheng-Mian Hu, Tong Zheng, V. Viswanathan et al. · 26 citations · ⚡4

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.