WhiFlash: Accelerating Speculative Decoding with Token-Level Cross-Paradigm Routing
This work empirically finds that drafting accuracy fluctuates dramatically within a single sequence, leaving significant performance unrealised by static paradigms and coarse-grained routing, and introduces WhiFlash, the first cross-paradigm SD method that unifies autoregressive and diffusion-based parallel drafting un...