Preprint
Aug 2026
Bole: Efficient Tree Speculation for Hybrid-Attention Language Models
Bole is presented, a kernel--runtime co-design that enables efficient tree speculation for hybrid-attention LLMs and couples efficient state management with a batch-wide verification budget calibrated to the complete hybrid forward.
Li Wang, Yi Su, Xiabao Wu et al.
· 1 citation