SG-MoE: Efficient Visual Compression for Multimodal Large Language Models via Semantic-Guided Mixture-of-Experts
With the rapid advancement of Multimodal Large Language Models (MLLMs), the redundancy of visual tokens in images has become a critical bottleneck constraining inference efficiency. Existing resampling methods often suffer from detail loss and fail to dynamically adapt to user instructions. In this paper, we propose SG...