Vision Transformers incur high computational costs when processing long visual token sequences. Existing reduction methods typically rank tokens independently and discard those deemed unimportant or redundant. We propose a reconstruction-guided framework for visual token condensation (ReConV), which summarizes the comp...
Xiaoya Tang, Shilong Liu, Daniel Smolyak et al.· 0 citations
This work introduces MID (Mask-Image Distributional Divergence), a distribution-level evaluation metric for medical image segmentation that compares the joint distribution of images and masks between a reference set and a set of predictions, without requiring sample-wise correspondence.
Vincenzo Marcianó, Xiao-Ming Zhang, Gianluca Guglielmo et al.· 0 citations
Functional brain connectome represents neural connectivity as a matrix of pairwise interactions between brain regions. Generation of functional connectomes is not only a question of validity; rather, having satisfied the constraints on the correlation matrix, the next step is to recover the class-conditional geometry b...
Protyay Dey, Ayush Roy, Hyuna Cho et al.· 0 citations
Vision-language-action (VLA) models show strong potential for end-to-end autonomous driving by leveraging world knowledge and understanding to excel in long-tail scenarios. However, current VLAs have two limitations: 1) Degeneration into vision-action (VA) models. For low latency, regression/flow-based methods directly...
Yuqi Ye, Caigao Jiang, Zhuonan Wang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Visual in-context learning (ICL) enables vision-language models (VLMs) to adapt at test time via demonstration examples, but its effectiveness depends critically on the examples selected. Recent counterfactual selection methods improve ICL by constructing demonstrations that expose how individual attribute changes affe...
Physical AI is commonly formulated around an explicitly specified task: given a goal or instruction, a system perceives, reasons, and acts. In many real-world settings, however, important tasks emerge from continuously changing world states before a person explicitly formulates them. We study this complementary problem...
Zhenhua Yang, Jiafeng Liang, Xingyu Zhou et al.· 0 citations
Research on video classification models has witnessed significant growth recently, accompanied by a significant increase in the demand for datasets to train such models. Existing video dataset curation approaches share a common bottleneck: candidate videos must be downloaded before any relevance judgment is made, which...
Mohammed Shabot, Jonathan Adams, Jan Van den Stock et al.· 0 citations
Deepfake speech detectors are typically evaluated as binary classifiers on fixed benchmarks, but deployed systems face evolving attacks, codecs, speakers, and recording conditions, with labels unavailable during operation. This makes it difficult to know when a detector operates in familiar conditions and can be relied...
Luk\'a\v{s} Proke\v{s}, Vojt\v{e}ch Stan\v{e}k, Anton Firc et al.· 0 citations
Progressive depth growth builds large networks by starting with shallow models and inserting layers during training. Recent advances in large language models have renewed interest in this longstanding approach, demonstrating benefits for training efficiency and reasoning alongside changes in internal computations. Howe...
Amir Mohammad Karimi Mamaghan, Ferdinand Kapl, Andrea Dittadi et al.· 0 citations
Generating and editing presentation slides requires models to combine accurate text rendering, instruction following, visual grounding, aesthetic design, and precise editing within one canvas. Existing work covers only subsets of these capabilities and lacks large-scale slide-native supervision and diagnostic evaluatio...
Jia-Hao Wang, Xi-Yan Jiang, Chen-Yuan Wu et al.· 0 citations
This work introduces VAttnPO (Visual Attention-Guided Policy Optimization), which uses answer-conditioned visual attention to refine token-level credit while preserving the verifier-derived trajectory-mean advantage to the GRPO sequence advantage.
Li-Hao Zheng, Zhen-Wei Shao, Zhou Yu et al.· 0 citations
Memory-based long-video generation aims to combine user control with long-range visual consistency. We organize this process into three functional components: a planner, an adapter, and a generator. Representative multi-shot systems couple memory to generator-specific interfaces or use predefined agent workflows, rathe...
Hang Xu, Guohui Zhang, Xiaoxiao Ma et al.· 0 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.