From Positionwise Confidence to Prefix Scheduling: Verifier Skipping in Speculative Decoding
This analysis shows that verifier skipping is a useful new lossy axis and, surprisingly, its key challenge is prefix scheduling rather than token prediction alone.