Skip to content

Category

computer vision

3,596 papers

#artificial intelligence Preprint Open access Oct 2026

Towards Long-horizon Embodied Agents with Tool-Aligned Vision-Language-Action Models

Vision-language-action (VLA) models are effective robot action executors, but they remain limited on long-horizon tasks due to the dual burden of extended closed-loop planning and diverse physical operations. We therefore propose VLAs-as-Tools, a strategy that distributes this burden across a high-level vision language...

Zixing Lei, Changxing Liu, Yichen Xiong et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Revealing the Gap in Human and VLM Scene Description through Counterfactual Semantic Saliency

Evaluating whether large vision-language models (VLMs) align with human perception for high-level semantic scene comprehension remains a challenge. Traditional white-box interpretability methods are inapplicable to closed-source architectures and passive metrics fail to isolate causal features. We introduce Counterfact...

Ziqi Wen, Parsa Madinei, Miguel P. Eckstein · 0 citations
#artificial intelligence Preprint Open access Oct 2026

HIMMEL: Hierarchical Interleaved Multi-stream Motion Encoding for Long Video Understanding

Long video understanding with multimodal language models suffers from three compounding bottlenecks: heavy decode cost to obtain dense RGB frames, token growth with frame count, and weak motion perception under sparse keyframe sampling. Existing remedies either prune visual tokens after decoding, which leaves the expen...

Haopeng Jin, Wenlong Zhao, Tao Yu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Multimodal synthesis of MRI and tabular data with diffusion in a joint latent space via cross-attention

We propose a multimodal latent diffusion model that jointly synthesizes volumetric magnetic resonance imaging (MRI) and tabular clinical data within a shared latent space via cross-attention. This approach enables coherent joint representation learning of MRI and tabular modalities for generative modeling. Our model ut...

Daniel Mensing, Jan Kapar, Jochen G. Hirsch et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Cross-Stage Coherence in Hierarchical Driving VQA: A Consistency Protocol and Parameter-Efficient Gated Context Routing

Graph Visual Question Answering (GVQA) for autonomous driving organizes reasoning into ordered stages, namely Perception, Prediction, and Planning, where planning decisions should remain consistent with the model's own perception. We present a comparative study of cross-stage context passing on DriveLM-nuScenes using t...

Gautam Kumar Jain, Carsten Markgraf, Julian St\"ahler · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective

Reconstructing 3D representations from 2D inputs is a fundamental task in computer vision and graphics, serving as a cornerstone for understanding and interacting with the physical world. While traditional methods achieve high fidelity, they are limited by slow per-scene optimization or category-specific training, whic...

Weijie Wang, Qihang Cao, Sensen Gao et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

PR-MaGIC: Prompt Refinement Via Mask Decoder Gradient Flow For In-Context Segmentation

Visual Foundation Models (VFMs) such as the Segment Anything Model (SAM) have significantly advanced broad use of image segmentation. However, SAM and its variants necessitate substantial manual effort for prompt generation and additional training for specific applications. Recent approaches address these limitations b...

Minjae Lee, Sungwoo Hur, Soojin Hwang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

IMAGAgent: Orchestrating Multi-Turn Image Editing via Constraint-Aware Planning and Reflection

Existing multi-turn image editing paradigms are often confined to isolated single-step execution. Due to a lack of context-awareness and closed-loop feedback mechanisms, they are prone to error accumulation and semantic drift during multi-turn interactions, ultimately resulting in severe structural distortion of the ge...

Fei Shen, Chengyu Xie, Lihong Wang et al. · 0 citations
#artificial intelligence Open access Mar 2026

Contrastive Metric Learning for Point Cloud Segmentation in Highly Granular Detectors

The results demonstrate that similarity-based representation learning combined with density-based aggregation is a promising alternative to object-centric approaches for point cloud segmentation in highly granular detectors.

Max Marriott-Clarke, Lazar Novakovic, Elizabeth Ratzer et al. · 1 citation
#artificial intelligence Preprint Open access Oct 2026

HybridStitch: Pixel and Timestep Level Model Stitching for Diffusion Acceleration

Iterative diffusion generation requires different amounts of model capacity at different token positions. Prior model combinations allocate capacity by denoising step or by drafting and verification role. We present HybridStitch, a training-free framework that uses token-level feedback to select the model supplying eac...

Desen Sun, Jason Hon, Jintao Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Toward Guarantees for Clinical Reasoning in Vision Language Models via Formal Verification

Vision-language models (VLMs) show promise in drafting radiology reports, yet they frequently suffer from logical inconsistencies, generating diagnostic impressions unsupported by their own perceptual findings or missing logically entailed conclusions. Standard lexical metrics heavily penalize clinical paraphrasing and...

Vikash Singh, Debargha Ganguly, Haotian Yu et al. · 0 citations

Articulated 3D Scene Graphs for Open-World Mobile Manipulation

MoMa-SG, a novel framework for building semantic-kinematic 3D scene graphs of articulated scenes containing a myriad of interactable objects, and the Arti4D-Semantic dataset, which provides parent-child relation annotations between container and contained objects together with object axis annotations across 62 in-the-w...

Martin Buchner, Adrian Rofer, Tim Engelbracht et al. · 12 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.