Skip to content

Author

Chaofan Tao

3 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

OVD: On-policy Verbal Distillation

On-policy Verbal Distillation is introduced, a framework that uses verbal scores from black-box teachers to rank student-generated sub-trajectories, retaining high-scoring ones and replacing low-scoring ones with teacher-generated continuations and suggests that retaining student-generated prefixes helps preserve explo...

Jing Xiong, Hui Shen, Shansan Gong et al. · 8 citations
#machine learning Conference Oct 2025

Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher Distillation

PerSyn (Personalized data Synthesis), a novel synthesis strategy that operates under a new ``Route then Generate''paradigm to create data tailored to each student model, enabling it to learn more effectively, is proposed.

Hengyuan Zhang, Shi-Ping Yang, Xiao Liang et al. · 21 citations

Prefilling-dLLM: Predictive Prefilling for Long-Context Inference in Diffusion Language Models

Prefilling-dLLM is proposed, a training-free prefill-decode disaggregation framework for dLLMs that partitions the prefix into N chunks, caches their KV representations once, and selects the top-K most relevant chunks with intra-chunk token sparsity for decoding, showing that sparse prefilling can outperform dense atte...

Jingfei Xiong, Qilong Han, Shansan Gong et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.