Skip to content

Author

Zhen-Xing Dou

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Nov 2026

Rethinking Supervision Scaling in On-Policy Distillation: From Dense Supervision to Stochastic Horizons

On-policy distillation (OPD) provides dense token-level supervision along student-generated trajectories, yet the learning benefits of longer trajectories may not scale proportionally with their computational cost. We investigate how supervision utility evolves with trajectory length. Controlled experiments reveal dimi...

Xin-Hao Yao, Zhen-Xing Dou, Yong Liu · 0 citations
Preprint Oct 2026

SRA: Selective Residual Adaptation for LLM Reasoning Enhancement

Knowledge distillation transfers reasoning capabilities from large language models to lightweight students. However, distilled small models still struggle with multi-step reasoning. We observe that the distribution divergences between teacher and student models along reasoning paths are highly sparse, and target tokens...

Zhen-Xing Dou, Kun-Hua He, Ming-Yang Yi et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.