Skip to content

Author

Hui Shen

We have 3 of 19 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Right On Q: Recovering Reasoning under Quantization via Self-Generated Trajectories

Quantization-aware training (QAT) aims to recover reasoning capabilities in low-bit large language models (LLMs). Existing recipes typically supervise the quantized student with the original full-precision model on fixed response sequences. However, the resulting low-bit quantized models still struggle on long-horizon...

Bo-Yuan Zheng, Jing Xiong, Chen-Wei Wu et al. · 0 citations

OVD: On-policy Verbal Distillation

On-policy Verbal Distillation is introduced, a framework that uses verbal scores from black-box teachers to rank student-generated sub-trajectories, retaining high-scoring ones and replacing low-scoring ones with teacher-generated continuations and suggests that retaining student-generated prefixes helps preserve explo...

Jing Xiong, Hui Shen, Shansan Gong et al. · 8 citations
#natural language process... Preprint Sep 2026

Efficient Reasoning Exploration via State-Conditioned Latent Steering with Progress Guidance

SPS is a training-free latent steering framework that constructs a state-conditioned Direction Bank containing multiple progress-guided steering vectors for different prefix-state regions and applies it at high-uncertainty transitions to guide the next reasoning step toward meaningful progress.

Hengyuan Zhang, Chenming Shang, Zun-Hai Su et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.