Skip to content

Author

Zhan-Yang Jin

3 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

Accelerating Cross-Model LLM Inference via Attention Map Reuse

LLM-augmented data workflows often involve multiple heterogeneous models operating over substantial shared context, such as schemas, tool specifications, interaction history, and intermediate results. Although prefix caching can reduce prefilling overhead, existing approaches are largely limited to reuse within the sam...

Zhan-Yang Jin, Yu-Ze Luo, Bin Cui et al. · 0 citations
#machine learning Preprint Oct 2026

From Gradients to Capabilities: Understanding Multi-Teacher On-Policy Distillation

Multi-teacher on-policy distillation (MOPD) aims to combine the strengths of RL-trained teachers in a single student, but how teacher signals affect parameter changes remains underexplored. We study Qwen3-1.7B with four domain teachers trained with RL from the same initialization as the student, comparing gradients, op...

Si-Qi Zhu, Suo-Zhi Huang, Kai-Xuan Zhang et al. · 3 citations
#natural language process... Preprint Sep 2026

Learning from Teacher Continuations at Student States

By regenerating prefixes from the evolving student, OLIVE continues improving after offline distillation plateaus while better preserving the general capabilities and plasticity of the student.

Haojin Wang, Dylan Zhang, Huai-Bo Chen et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.