Da-Xiang Dong

VidHarness: Evolving Agent Harnesses for Cost-Efficient Long Video Understanding

Vision-language models (VLMs) can answer questions about hour-long videos, but processing every frame is prohibitively expensive, even though the evidence for a question usually spans only a few seconds. Video agents, i.e., harness programs wrapped around a frozen VLM, address this by observing the video selectively, y...