Skip to content

Category

computer vision

3,560 papers

#artificial intelligence Preprint Open access Oct 2026

VisualEvolve: A Skill Self-Evolution Framework for Visual Reasoning

Visual tool use enables vision-language models (VLMs) to acquire task-relevant evidence, but its effectiveness can be limited by predefined visual operations and the tool-use strategies learned during training. Representing these operations and strategies as reusable external skills allows them to be refined through se...

Jiawei Wang, Yucun Li, Xueqi Li et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

CountVideoBench: A Benchmark to Evaluate Prediction Biases on the Object Counting task by Video-Language Models

Object counting in videos remains a poorly characterized capability of multimodal large language models. Counting questions are included in many existing VideoQA benchmarks, but the ground-truth count distributions in these benchmarks are heavily skewed toward small values. Across the nine benchmarks we survey, the med...

Marc Chapus, Carlos Crispim-Junior, V\'eronique Eglin et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

RayCo4D: Ray-Conditioned Continuous Motion Model for Monocular 4D Dynamic Reconstruction

Reconstructing dynamic 3D scenes from monocular video requires inferring motion from noisy and intermittently visible observations. Long-range tracks provide valuable geometric constraints, but integrating their fragmented temporal coverage into shared, continuous motion remains challenging. We introduce \textbf{RayCo4...

Yuanxiang Ni, Xianliang Huang, Ruihan Hou et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Gated Prototype Transfer for Zero-Support Medical Vision Language Model

Realistic few-shot adaptation of medical vision-language models (VLMs) can leave low-prevalence classes without any labeled support. The training-free SS- Text+ solver remains operational in this setting, but its zero-support prototypes receive no visual adaptation and fall back to a purely textual class prototype. We...

Sumaiya Fazal, Rizwan Qureshi, Laleh Behjat et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

ABACUS: A Benchmark for Image Editing Models to Assess Object Category and Counting Under Scene Conservation

Instruction-based image editing models can now add, remove a specified number of objects or change their category while preserving the scene. Yet these models often fail to produce the correct number, and these failures grow sharply as scenes become more complex and the requested count increases. Current benchmarks lar...

Aymen Lassoued, Angelique Loesch, Romaric Audigier · 0 citations
#artificial intelligence Preprint Open access Oct 2026

GALA: Geometry-Aware Language Model for Controllable Object Arrangement

Reasoning about fine-grained placement constraints, such as support and containment, is essential for realistic 3D scene creation. It remains a significant challenge for existing methods that rely on simplified object representations like oriented bounding box (OBB), which are blind to the detailed geometry. To address...

Chucheng Xiang, Runze Wang, Zhi Deng et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

VGL-stGen: Learning a shared multimodal model for lung histology and spatial transcriptomics

VGL-stGen is a multimodal large language model adapted from a pretrained medical vision-language model using paired lung H&E and spatial transcriptomics with single-cell references. Training integrates image-expression and expression-cell-type pairs, and gene-conditioned pseudo-labels transfer transcriptomic cell-type...

Haenara Shin, Dongjoo Lee, Sungwoo Bae et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

PI-MLLM: Psychophysics-Inspired Multimodal Large Language Model for Oddly Satisfying Video Emotion Analysis

Oddly Satisfying Videos (OSVs) can evoke strong viewer responses through repetitive motion, visual tactility, and ASMR-like sounds despite containing few explicit semantic emotion cues. This makes OSVs a challenging setting for Video Emotion Analysis (VEA), since most existing methods focus on semantic video content an...

Yuheng Zhang, Jie Zhang, Yuecong Min et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Region-Guided Food-Package Evidence Extraction and Abstention-Aware Draft R3337 Screening with Selective VLM Review

Applying South Africa's draft R3337 warning criteria to food-package photographs requires nutrition, ingredient and product-form evidence. This study presents a region-guided evidence extraction and abstention-aware screening workflow for draft R3337. A three-class detector localises nutrition information panels, ingre...

Mayimunah Nagayi, Alice Scaria Khan, Tamryn Frank et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Offline Makes Online Better: Calibrated Cache Compression for Video Generation

Token merging is an effective approach to reducing KV-cache memory consumption in autoregressive video generation by clustering temporally redundant tokens and retaining only a small set of representatives. Existing methods, however, typically apply a uniform merging ratio across all attention layers and heads. We obse...

Zhen Wang, Ning Lai, Qingtao Yu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

MoDDiT: Simple Token Routing in Diffusion Transformers

Real-time video generation, interactive world models, and on-device image synthesis are almost a reality. Diffusion Transformers (DiT) achieve excellent sample quality, shifting the bottleneck to the throughput of the models themselves. Natural images are inherently sparse, as large portions of an image are often backg...

Jarek Liesen, Matthew T. Jackson, Benjamin Ellis et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Auditing Where Concept Bottleneck Accuracy Comes From on CUB

Concept Bottleneck Models (CBMs) promise predictions that humans can inspect and correct through concepts such as "curved beak". Yet on CUB-200-2011, their standard benchmark, progress is measured like that of ordinary classifiers: by task and concept accuracy. Neither reveals whether the label is predicted from the ex...

Sascha Saralajew, Eleonora Poeta, Eliana Pastor et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.