Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal understanding, but their practical deployment is still limited by the substantial computation introduced by excessive visual tokens. Visual token pruning offers an effective solution by removing redundant visual tokens during inference...
Peng-Cheng Zheng, Chao-Ning Zhang, Ya Wen et al.· 0 citations
This work proposes MoR-MLLM, a computation-sparse MLLM based on the recent Mixture-of-Recursions (MoR) framework, which introduces adaptive per-token recursion, allowing the model to dynamically adjust its recursive depth and allocate more computation to visually or linguistically challenging tokens while skipping redu...
Peng-Cheng Zheng, Chao-Ning Zhang, Jia-Xing Yan et al.· IEEE transactions on multime...· 1 citation
A budget-aware framework that systematically orchestrates when and what to teach and integrates a solvability-aware teacher gate to dictate the teacher model and a score-guided turn selection mechanism to decide what informative turns to retain is proposed.
Jian-Wei Zhang, Si-Han Cao, Peng-Cheng Zheng et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.