Exploiting answer-invariant redundancies in satellite imagery for efficient VLM inference on edge
Rift is presented, a two-stage system that performs query-conditioned tile pruning followed by elastic prefill to reduce token budget and reduces energy by 78% and latency by 69%, while increasing accuracy from 45% to 73%.
Ishani Janveja, David Zhang, Seoyul Oh et al.
· 0 citations