Zerui Wang

Jet-Long: Efficient Long-Context Extension with Dynamic Bifocal RoPE

Jet-Long is proposed, a tuning-free zero-shot method that pairs a local RoPE-faithful window with a long-range window whose rescaling factor adapts dynamically to the current sequence length via a parameter-free analytic schedule, recovering the base model exactly at short inputs while extrapolating cleanly at long one...