DeLS-Spec: Decoupled Long-Short Contexts for Parallel Speculative Drafting
DeLS-Spec is proposed, a decoupled long-short context speculative decoding method that treats the fixed DFlash model as a long-context expert and introduces a lightweight local head as a short-context expert and consistently improves speedup and average acceptance length over DFlash across math, code, and dialogue benc...