Reflection on Visual Evidence (ReVuE), an on-policy distillation method for visual agents that translates trajectory-level evidence diagnosis into targeted token-level supervision, guiding students to improve their visual evidence acquisition and reasoning.
Shaohang Wei, Feifan Song, Guangyue Peng et al.· 0 citations
DuLBE is introduced, which couples dual-mode low-rank learning with a bridge-prototype ensemble classifier for exemplar-free CIL and achieves state-of-the-art CIL performance while retaining the high parameter efficiency of low-rank tuning.
Chi-Yuan He, Zi-Huan Qiu, Fan-Man Meng et al.· 0 citations
One-dimensional (1D) variable-length visual tokenizers enable adaptive compression by varying the number of tokens, allowing downstream autoregressive (AR) models to flexibly trade off generation quality against computational cost using a single tokenizer. However, existing approaches based on nested dropout often fail...
Jiawei Zhang, Shuhao Liu, Rong Huang et al.· 0 citations
FocusVTC, which combines compressed low-DPI global views with selective region enhancement, integrating enhanced views into ongoing reasoning, is introduced, which breaks this trade-off through adaptive resolution while preserving general multimodal capabilities.
Fang-Zhi Zhong, Xue-Rui Qiu, Yu-Qi Pan et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Symbolic state supervision raises the 20M model's frame accuracy from 31.1% to 67.3% at the same training-data budget, suggesting that learning representations of state changes can complement scaling.
Wei-Hang Guo, Xiao-Yu Wu, Yi-Fei Wang et al.· 0 citations
A Step-Supervised Structured Reasoning training framework is proposed and employed to train ThinkingGuard, a specialized guard model that decouple implicit risk identification into progressive cognitive stages, and utilize a step-reward Monte Carlo Tree Search algorithm to explore optimal reasoning trajectories.
Ruo-Chen Zhang, Yao Huang, Yi-Tong Sun et al.· 0 citations
FM-ReID is proposed, an end-to-end framework that formulates local representation learning as selective competitive token routing as an effective way to augment holistic foundation-model representations, supporting competitive token routing as an effective way to augment holistic foundation-model representations.
Zhi-Qiang Li, Xiao-Wei Zhou, Ze-Yuan Sun et al.· 0 citations
A mechanistic analysis of the VLM model's internal attention patterns shows that a simple describe-then-decide prompting strategy increases vision attention by 30-40% during generation, and task-specific fine-tuning improves dermatology classification but reduces cross-domain medical question-answering performance in t...
Janet Wang, Yun-Bei Zhang, Xiao Wang et al.· 0 citations
When evaluated on unseen species, the best adapted VLMs outperformed specialist models trained on the same data in identifying merge errors and LoRA on a few thousand labels brought open models level with specialist models.
Yi-Cong Li, Jun-Jie Wang, Leander Lauenburg et al.· 0 citations
Cross-modal associations are systematic pairings of features across modalities, such as the association of'bouba'with round shapes and'kiki'with sharp shapes. Prior work has compared humans and vision-language models (VLMs) on such associations, but often using different stimuli or tasks between humans and models. Here...
Su-Min Hong, Katsumi Ibaraki, Renee Shi et al.· 0 citations
STAIRCASE POLICY is introduced, a streaming inference and training framework that turns a flow-matching VLA into a JEPA-style WAM and partitions a large action chunk into sub-chunks at staggered denoising stages, enabling long-horizon execution without repeated full policy inference.
Guoheng Sun, Chen Chen, Jin Wang et al.· 0 citations
This work introduces Online VIL (Online Versatile Incremental Learning), a novel scenario where class concepts and visual domains evolve simultaneously online without explicit boundaries, and proposes a novel framework TopFlow, Topology preservation with Flow matching representation that contains two complementary mech...
Jae-Ho Lee, Minji Park, Jun-Yeong Moon et al.· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.