This paper first probes MCoT faithfulness by measuring how much the prediction changes when its visual and textual thoughts are intervened, and proposes Sufficient-Component Cause Model (SCCM) learning, which encourages the MCoT to generate sufficient yet minimal visual components that are independently capable of lead...
Zujing Liu, Jun-Wen Pan, Qi She et al.· arXiv.org· 15 citations· ⚡2
Camera motion recognition requires separating viewpoint changes caused by camera translation, rotation, or zoom from object motion and scene dynamics. Video-language models often rely on semantic cues and struggle with the geometric evidence needed for this task. Joint-Embedding Predictive Architectures such as V-JEPA...
Xiang-Kun Shi, Han-Hui Li, Shi-Yue Zhang et al.· 0 citations
HOMIE proposes a better MLLM integration strategy to extract knowledge of reference-level relationships without compromising the controllability of text encoders or incurring costly re-alignment, and introduces global multimodal guidance within self-attention to better align MLLM-derived semantic features with VAE toke...
Yiyang Cai, Nan Chen, Rongchang Xie et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.