Jul 2026
SparseVLM+: Visual Token Sparsification With Improved Text-Visual Attention Pattern.
Improved text-visual attention patterns are introduced to enhance the fidelity of query-aware vision token selection and the Attention Gravity effect is correct, and a rank-based strategy to adaptively determine the sparsification ratio for each layer is introduced.
Yuan Zhang, Junpeng Ma, Qizhe Zhang et al.
· IEEE Transactions on Pattern... · 2 citations