Skip to content

Category

computer vision

3,687 papers

#computer vision Preprint Oct 2026

EgoVoice: Proactive Spoken Assistance from Egocentric Multimodal Streams

Wearable augmented reality (AR) assistants are moving toward continuous real-world interaction, where they perceive the user's activity through first-person video and audio and provide timely spoken guidance without being explicitly asked. While proactive video assistants, spoken dialog systems, and egocentric task und...

Heeseung Kim · 0 citations
#computer vision Preprint Oct 2026

SignRAG: Unified Retrieval-Augmented Gloss-Free Sign Language Translation

Contemporary decoder-only large language models (LLMs) have demonstrated strong capabilities across a wide range of domains. However, existing pretraining paradigms for gloss-free sign language translation (SLT) are largely designed around conventional encoder-decoder pretrained language models, which limits their dire...

Zhi Rao, Yucheng Zhou, Qian-Ran Sun et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Road Maps as Free Geometric Priors: Weather-Invariant Drone Geo-Localization with GeoFuse

Drone-view geo-localization aims to match a query drone image, often captured under adverse weather conditions (e.g., rain, snow, fog), against a gallery of geo-tagged satellite images. Weather-induced degradations in the drone view, such as noise, reduced visibility, and partial occlusions, severely exacerbate the int...

Yunsong Fang, Tingyu Wang, Zhedong Zheng · 0 citations
#machine learning Preprint Oct 2026

One Block, Multiple Depths: Recurrent Vision Transformers with Depth-Programmed Experts

In this work, we show that a single Transformer block, applied recurrently, can match the accuracy of a full-depth vision encoder at comparable inference FLOPs without intermediate feature distillation. reViT restores depth-specific transformations by representing the FFN at each recurrent depth as a convex combination...

Adrian Bulat, Yassine Ouali, G. Tzimiropoulos · 1 citation
#machine learning Preprint Open access Oct 2026

Beyond Spatio-Temporal Priors: A Generalizable Approach for Dense Correspondence Matching

Dense correspondence matching has historically been bounded by simplifying spatio-temporal priors, such as smooth motion and rigid geometry. While effective for classical tasks, these assumptions break down in image editing and reference-guided generation (IEG), where transformations can preserve visual identity while...

Luping Liu, Bingyi Kang, Yifan Wang et al. · 0 citations
#machine learning Preprint Oct 2026

WOVEN: Weaving Visual World Modeling into Multimodal LLMs

Multimodal large language models (MLLMs) struggle with spatial, embodied, physical, and temporal reasoning. We hypothesize that these failures reflect a shared deficit in visual transition reasoning, and test whether this capability can serve as a shared training primitive, one that different models can learn from diff...

Zhe-Yu Fan, Yue Zhang, Ming-Kai Deng et al. · 0 citations
#machine learning Preprint Open access Oct 2026

DVLA-RL++: Dual-Level Vision-Language Alignment with Reinforcement Learning Gating for Few-Shot Learning

Few-shot learning aims to recognize novel categories from limited labeled examples. Recent studies incorporate textual semantics to compensate for limited visual observations and improve class representations. However, high image-text agreement may reflect both intrinsic object properties and incidental context, making...

Wenhao Li, Xianjing Meng, Qiangchang Wang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Perception Test 2026: Challenge Summary and Extension to City-scale Audio-Visual Reasoning

Continuing the Perception Test challenge series, we organised the fourth edition as a workshop at the European Conference on Computer Vision (ECCV) 2026 in Malm\"o, Sweden. This edition focused on spatial intelligence and featured four different tracks: unified multiple-choice videoQA and grounded videoQA from the orig...

Fedor Kitashov, Jo\~ao Carreira, Shiry Ginosar et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Revisiting Identity and Spectra Dispersion in Media-Bridged Time Series Forecasting: Linking Multivariate Signals and Narrative Flows

Media-bridged time series forecasting is expanding to encompass traditional "multivariate" and emerging "multimodal" (e.g., through textual assistance). Existing Time Series Forecasting (TSF) models still rely on paradigm-specific relation, fusion, and temporal modules, hindering a common forecasting backbone across nu...

Jierui Lei, Wenjian Zhang, Qingyi Yang et al. · 0 citations
#machine learning Preprint Oct 2026

Open-Vocabulary Audio-Visual Event Localization via Complex-Valued Fusion

Open-Vocabulary Audio-Visual Event Localization (OV-AVEL) labels each video segment with an event class, including classes that were never seen during training. The dominant pipeline uses a frozen multimodal foundation model (e.g. ImageBind) to embed the visual frame, the audio mel-spectrogram, and each candidate class...

A. Praveen, Koteswar Rao Jerripothula, Pratik Joshi et al. · 0 citations
#machine learning Preprint Oct 2026

HAND: A Biologically-Inspired Activation Function that Improves Generalisation and Sample Efficiency in Image Classification

DNNs exhibit robustness and generalisation issues not seen in humans. They are also far less data-efficient learners, requiring considerably more training samples to accurately classify novel exemplars. Inductive bias could help with these issues by providing in-built mechanisms to improve generalisation, and hence, re...

M. Spratling, Heiko Schutt · 0 citations
#machine learning Preprint Oct 2026

WAM-Cache: Staleness-Bounded KV Reuse for Efficient World Action Models

World Action Models (WAMs) enable generalist robot manipulation by conditioning an action expert on representations from a pretrained video Diffusion Transformer (DiT). In closed-loop control, the video DiT runs at every chunk to encode the current observation into layerwise key-value (KV) pairs that the action expert...

Kai-Qi Ding, Yang He, Rui-Jie Quan et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.