Skip to content

Category

computer vision

3,798 papers

#artificial intelligence Preprint Sep 2026

LEGO-OPD: Factorized Teacher Composition for Multimodal On-Policy Distillation

Multimodal on-policy distillation (OPD) aims to improve visual grounding while preserving the strong reasoning capabilities of language models. Recent multi-teacher approaches combine LLM and VLM teachers to provide complementary supervision. However, directly using a VLM's full predictive distribution entangles its vi...

Jaeyun Shin, Hangeol Chang, Jong Chul Ye · 0 citations
#artificial intelligence Preprint Sep 2026

DriftOPD: Sequence-Level Reverse-KL Distillation for One-Step VLA Policies

Vision-Language-Action (VLA) models increasingly rely on action experts that generate short action chunks under receding-horizon control. While chunk-level training is convenient across robot embodiments, it optimizes local action likelihood without explicitly accounting for long-horizon task success. Sequence-level re...

Youngjun Jun, Kyumin Choi, Young Min Kim et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Pixel Reconstruction: Retrieval-Guided Glyph-Aware Restoration for Low-Resource Manchu Historical Documents

This work proposes a retrieval-guided glyph-aware restoration framework that goes beyond pixel reconstruction by explicitly incorporating glyph-level structural knowledge and integrates this information into the reconstruction process, improving the recovery of degraded character structures under low-resource condition...

T. Huang, Dongdong Wang, Ming-Qiu Liang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Decoding the Disaster: Multi-Task Geospatial Reasoning with Vision-Language Models and Crowdsourced Imagery for Disaster Mapping

Crowdsourced imagery provides timely, fine-grained, street-level observations for disaster mapping, complementing conventional remote sensing imagery (RSI) during emergency response. However, such imagery is often unstructured, spatially ambiguous, and lacks reliable geographic metadata, making manual geolocalization a...

Wen-Ping Yin, Fabian Desuer, Zi-Qi Liu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

LENS-GRF: Permutation-Invariant Lesion Evidence Network with Gated Residual Fusion for Acne Severity Grading and Multi-Rater Clinical Oracle Analysis

Automated acne severity grading requires both whole-face context and fine-grained lesion evidence. We propose LENS-GRF (Lesion Evidence Network with Set-Transformer and Gated Residual Fusion), an interpretable multi-stage framework for four-class acne severity grading. The method combines Adaptive Facial Skin Segmentat...

Muhammad Muhtasim Shahriar, M. F. Mridha · 0 citations
#artificial intelligence Preprint Open access Oct 2026

A Framework for Egocentric and Exocentric Procedural Understanding via Temporal Segmentation and Semantic Abstraction

Long-horizon ego/exo data contains rich procedural evidence, but are redundant, noisy, and costly to process or retain. We propose a compact framework that converts continuous multimodal workplace video into a structured Procedural State Memory, implemented as a Work Environment Model (WEM). Inspired by event segmentat...

Vivek Chavan, J\"org Kr\"uger · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Spatial Lifting for Dense Prediction

We present Spatial Lifting (SL), a novel methodology for dense prediction tasks. SL operates by lifting standard inputs, such as 2D images, into a higher-dimensional space and subsequently processing them using networks designed for that higher dimension, such as a 3D U-Net. Counterintuitively, this dimensionality lift...

Mingzhi Xu, Tao Zhou, Yong Li et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

STATERA: Hidden Mass Estimation via Zero-Shot Sim-to-Real Kinematics using Frozen Temporal Tubelets

Vision models pretrained for frame-level appearance often struggle to infer hidden physical properties from motion. We study center-of-mass (CoM) localization for opaque, asymmetric rigid bodies from short monocular videos, where surface cues and point tracking are unreliable under self-occlusion. We propose STATERA, w...

Animesh Varma · 0 citations
#artificial intelligence Preprint Oct 2026

VISTA: A Visual Harness for Reasoning in an Interactive World

We show that multimodal models possess strong reasoning abilities and that an appropriate harness can unlock their potential to solve tasks across diverse interactive environments. We introduce VISTA, a visual harness that gives a general-purpose multimodal model long-horizon vision. VISTA allows the model to directly...

Qiu-Shi Han, Ke-Ya Hu, Lin-Lu Qiu et al. · 6 citations · ⚡1
#artificial intelligence Preprint Open access Oct 2026

VideoEvolve: Evolving Agent Harnesses for Video Temporal Grounding

Video temporal grounding aims to localize events in videos from natural-language queries. For agents built around frozen video-language models, the harness determines how queries guide temporal predictions and how those predictions are refined. Manually refining these harnesses requires diagnosing grounding failures an...

Bingjun Luo, Yuhuan Fan, Jialin Guo et al. · 0 citations
#artificial intelligence Preprint Oct 2026

CoEvolve: Construct-to-Edit Visual Grounding with Bidirectional State Refinement

Visual grounding localizes an object described by language with a bounding box. Most multimodal grounding models compress target identification, spatial reasoning, and boundary estimation into one terminal prediction. Free-form rationales make reasoning linguistically explicit but do not necessarily expose measurable,...

Dong-Wei Sun, Yu-Jie Zhang, Bo-Wen Yao et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Towards Reliable Vision-Language Models for Autonomous Driving

Vision-Language models (VLMs) are increasingly being explored in autonomous driving for tasks such as scene understanding, driving reasoning, decision-making, and end-to-end driving. As their role becomes more prominent, ensuring their robustness and reliability is increasingly important. In real-world conditions, visu...

Manasa Mariam Mammen, Priyanka Mary Mammen, Zafer Kayatas et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.