KVE-KD: Key Visual Evidence-Guided Knowledge Distillation for Vision-Language Models
Knowledge distillation is crucial for deploying vision-language models on resource-constrained devices. However, existing methods typically impose uniform supervision across visual tokens or rely on static token selection, which confuses task-relevant cues with background noise and degrades cross-modal reasoning. To ad...
Jian-Bing Zhang, Xin Sun, Shan-Wen Wang et al.
· 0 citations