Skip to content

Author

Qi-Yong Zhong

We have 11 of 11 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Open access Oct 2026

Distilling Transitional Patterns to Multimodal Large Language Models for Session-based Recommendation

Session-based recommendation (SBR) predicts the next item based on anonymous sessions. Traditional SBR explores user intents based on ID collaborations or auxiliary content. To further alleviate data sparsity and cold-start issues, recent Multimodal SBR (MSBR) methods utilize simplistic pre-trained models for modality...

Jia-Jie Su, Qi-Yong Zhong, Yun-Shan Ma et al. · 0 citations
Book Open access Nov 2026

Personalized Context-Conditioned Tokenization for Generative Recommendation

Generative recommendation (GR) represents user actions as sequences of discrete tokens (often referred to as semantic IDs) and predict future interactions through autoregressive generation. This paradigm offers advantages such as compact representations, scalability, and the potential to unify retrieval and ranking. Ho...

Qi-Yong Zhong, Jia-Jie Su, Yun-Shan Ma et al. · 0 citations
Preprint Oct 2026

Learning Robust Personalized Prompts for LLM-Driven Sequential Recommendation

LLM-driven sequential recommendation formulates next-item prediction as autoregressive generation conditioned on natural-language prompts. However, minor wording changes in semantically equivalent prompts can cause substantial performance fluctuations, undermining robustness and requiring costly manual prompt engineeri...

Xiao-Lin Zheng, Qi-Yong Zhong, Jia-Jie Su et al. · 0 citations
Preprint Sep 2026

Data-Free On-Policy Distillation: How Far Can We Go Without External Data?

On-policy distillation (OPD) is increasingly applied to frontier foundation model post-training. Prior work in this area has largely focused on algorithmic advances, yet it remains unclear how much OPD depends on its training questions and, in particular, how far this dependence can be reduced. Across two representativ...

Gengsheng Li, Mao Zheng, Ming-Yang Song et al. · 0 citations
#natural language process... Preprint Oct 2026

ReCal: Calibrating Structured Pruning for On-Policy Distillation Recovery

Structured pruning reduces the deployment cost of reasoning language models, but the resulting capability degradation can hinder subsequent on-policy distillation (OPD) recovery. Because OPD relies on student-generated trajectories, pruning damage that persists after offline distillation can limit its effectiveness. We...

Hou-Cheng Jiang, Mao Zheng, Ming-Yang Song et al. · 2 citations
#natural language process... Preprint Aug 2026

RePolicy: Reinforcement Learning for Safety-Policy Invocation in Agent Safeguards

Safeguarding language model agents requires assessing complete execution trajectories under context-dependent safety policies. Existing policy-aware safeguards mainly rely on prompting or supervised fine-tuning, limiting their ability to adapt to unseen trajectories and changing policy contexts. We propose RePolicy, an...

Hou-Cheng Jiang, Bo-Xuan Zhang, Qi-Yong Zhong et al. · 0 citations

MAS-OPD: On-Policy Distillation for Multi-agent Systems

MAS-OPD is presented, where Role-Advantage Specialization defines the role advantage as the difference between the teacher signals under target and non-target role conditions, and Privileged Attribution for Coordination attributes an interaction conflict to its source and supplies it to the teacher alone as privileged...

Qi-Yong Zhong, Mao Zheng, Ming-Yang Song et al. · 0 citations

On-Policy Distillation with Curriculum Turn-level Guidance for Multi-turn Agents

Guided On-Policy Distillation (Guided-OPD), a simple yet effective algorithm that mixes teacher- and student-generated turns within each rollout and schedules the teacher's intervention probability along a curriculum that decays to zero is proposed.

Gengsheng Li, Mao Zheng, Ming-Yang Song et al. · 24 citations · ⚡3
#artificial intelligence Preprint Sep 2026

Data-free On-policy Distillation

DF-OPD matches and even surpasses real data, and the questions it produces track the teacher's own post-training data on three key diagnostics of training dynamics, which other real datasets do not.

Gengsheng Li, Mao Zheng, Ming-Yang Song et al. · 1 citation
Jul 2026

EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Models

Experiments on reasoning, code-generation, scientific-knowledge, scientific-knowledge, and tool-use benchmarks show that these implementations can be executed through the same verl-based backend while retaining their method-specific objectives and task-dependent performance profiles.

Jie Sun, Mao Zheng, Mingyang Song et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.