Author

Yong-Qi Qiao

h-index 0 View on Semantic Scholar

We have 1 of 1 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

SOLAR: A State-Driven Online Learning Rate Scheduler for LLM Pretraining

Across autoregressive language-model pretraining, SOLAR improves final perplexity over tuned static schedules and automatic LR tuners for dense models from 60M to 1B, AdamW and Muon, and two MoE settings up to 3B.

Qiu-Lin Shang, Bin-Yu Wang, Yong-Qi Qiao et al. · 0 citations