Bole: Efficient Tree Speculation for Hybrid-Attention Language Models
Bole is presented, a kernel--runtime co-design that enables efficient tree speculation for hybrid-attention LLMs and couples efficient state management with a batch-wide verification budget calibrated to the complete hybrid forward.