Video temporal grounding (VTG), which localizes the start and end times of a queried event in an untrimmed video, is a key test of whether multimodal large language models (MLLMs) understand not only what happens but also when it happens. Although modern MLLMs describe video content fluently, their timestamp prediction...
Dazhao Du, Liao Duan, Jian Liu et al.· 0 citations
Results show that decoder-side adaptation alone can improve a meaningful subset of grounding failures under a fixed multimodal representation, while preserving broader multimodal capabilities.
EverAnimate is proposed, an efficient post-training method for long-horizon animated video generation that preserves visual quality and character identity by anchoring generation to a persistent latent context memory, consisting of two complementary mechanisms.
Wuyang Li, Yang Gao, Mariam Hassan et al.· arXiv.org· 3 citations· ⚡1
This work presents a reproducible benchmark for 3D I2I translation in oncological imaging that compares seven generative models: three Generative Adversarial Networks (Pix2Pix, CycleGAN, and SRGAN) and four latent models (Latent Diffusion Model, Latent Diffusion Model+ControlNet, Brownian Bridge, and Flow Matching).
G. Romoli, A. Capoccia, Filippo Ruffini et al.· arXiv.org· 1 citation
Reach audiences
Advertise in front of researchers, engineers, and readers.
Vision Transformers (ViTs) implement depth by stacking independently parameterized blocks, but it remains unclear how much of this parameterization is necessary and how much can be replaced by recurrent reuse. We study this question with bViT, a single-block recurrent ViT that repeatedly applies the same transformer bl...
Michal Byra, Pawel Olszowiec, Grzegorz Stefanski et al.· 0 citations
FraudBench is a multimodal benchmark for detecting AI-generated fraudulent refund evidence and shows that current MLLMs often recognize real-damaged evidence but fail on many fake-damaged subsets, with fake-damage detection rates far below the 50\% baseline on most generator subsets.
This work introduces LAGO (LAnguage-Guided adaptive Object-region focus), which reframes localized recognition as language-guided directed region discovery and addresses the circular dependence between recognizing a class and locating its supporting evidence, while preserving complementary local, contextual, and global...
Jun-Yi Hu, Qiji Zhou, Lei Zhang et al.· arXiv.org· 0 citations
OneWM-VLA is introduced, which represents each retained camera view with one predictive token per future step, which incorporates visual prediction into a pretrained VLA policy while keeping the generative sequence compact.
Zuojin Tang, Shengchao Yuan, Xiaoxin Bai et al.· arXiv.org· 6 citations
Human visual reasoning is governed by active vision, a process where meta-cognitive control drives top-down goal-directed attention, dynamically routing foveal focus toward task-relevant details while maintaining peripheral awareness of the global scene. In contrast, modern Vision-Language Models (VLMs) process visual...
Brown Ebouky, Gabriele Carrino, Niccolo Avogaro et al.· 0 citations
MMDG-Bench is introduced, the first unified and comprehensive benchmark for MMDG, which standardizes evaluation across six datasets spanning three diverse tasks: action recognition, mechanical fault diagnosis, and sentiment analysis.
Hao Dong, Hong-Zhao Li, Shu-Pan Li et al.· arXiv.org· 0 citations
Vision-Language Models (VLMs) hallucinate objects that are not present, and a growing line of work tries to curb this by feeding the model its own generated caption as auxiliary evidence -- assuming that a caption, once available, is something to consume. We show this fails: naively appending a caption can lower accura...
The DRAGON dataset contains 11,664 annotated question instances from six diagram QA datasets, with a 2,445-instance test set carrying human-verified evidence annotations and a standardized evaluation framework, which supports future research on models that ground their predictions in visual evidence.
Anirudh Iyengar, Tampu Ravi Kumar, Gaurav Najpande et al.· arXiv.org· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.