Skip to content

Category

computer vision

3,687 papers

#artificial intelligence Preprint Open access Oct 2026

SceneForesee: Learning Scene Evolution for Spatiotemporal Reasoning

Large multimodal models (LMMs) need to understand how entities move and interact as a scene develops. This requires following the same entities over time and relating their observed motion to subsequent changes. We formulate Scene Evolution Understanding (SEU), a task for predicting and interpreting this change. Given...

Chaoyue Li, Shoudong Han, Haoyang Wu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

RealityBench: Simulated Environments to Evaluate a Vision Language Model's Ability to Document Human Physical Work

Augmenting worker capabilities in the physical world through guidance has been a decades-long goal for AI agents. One key supporting capability is to understand what the worker is doing, seeing through the human's camera or smart glasses, and assist them in documentation. Despite advances in vision language models, the...

Andrew Perrault, Anmol Takiar, Dominik Wienecki et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

TraceSampler: Making Sampling Errors Predictable and Correctable for Accelerated Generative Sampling

Accurate sampling from continuous-time generative models can require many model evaluations. Low-step sampling reduces cost, but coarse updates introduce endpoint errors that can accumulate and degrade generation quality. We introduce TraceSampler, a post-training method that corrects these errors without modifying the...

George Matthew (University of Exeter, United Kingdom), Guoqiang Zhang (University of Exeter et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

EV-JEPA: Elastic V-JEPA for Any Device and Cross-Device Inference

Foundation models like V-JEPA are increasingly deployed across a heterogeneous edge-cloud continuum spanning smart glasses, phones, robots, and servers. Yet, they are typically trained as rigid, fixed-capacity networks bound to one device, supporting neither reconfigurable compute budgets nor collaborative execution. E...

Anxhelo Diko, Jieyu Lin, Stefano Ambrogio et al. · 0 citations
#artificial intelligence Preprint Oct 2026

MvFFN: Multi-view Floor plan Feed-forward Network for Unposed Wide-Baseline Panorama Layout Reconstruction

Reconstructing accurate camera poses and floor-plan layouts from sparse, unposed, wide-baseline RGB panoramas remains a challenging open problem. Direct multi-room floor-plan prediction is especially difficult in this setting: pose, geometry, semantics, and global layout structure are tightly coupled, yet a complete fl...

Yuguang Li, Yi-Chuan Deng, Zi-Xuan Liu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

GeoFix: Geometry Fixing for 4D Consistent Generation

Video diffusion models increasingly serve as priors for 4D generation, but the generated videos often lack geometric consistency. Recent approaches address this through post-training by designing geometric rewards, yet this can degrade texture and fine detail, requiring auxiliary appearance rewards and careful reward b...

Yeobin Hong, Hyojun Go, Dohun Lee et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Latent World Action Model for GUI Agents

Pixel-space world models have recently emerged as a promising approach for GUI agents, predicting future screens prior to execution and subsequently re-perceiving them for action selection. However, this two-stage paradigm faces two key challenges in GUI environments: (L1) the high computational cost of pixel reconstru...

Seungjun Yu, Hojun Choi, Seojeong Park et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

CAPTOR: a vision-language foundation model for Chest-Abdomen-Pelvis Oncologic CT

Purpose : To develop and evaluate CAPTOR, a deep-learning vision-language foundation model for oncologic chest-abdomen-pelvis (CAP) CT interpretation. Materials & Methods : CAPTOR (Chest-Abdomen-Pelvis foundaTion model for Oncologic Radiology) is a contrastive vision-language model, trained using a pretraining strate...

S\'el\'ena Jean-Mactoux, Sophie Loizillon, Ghina Jardali et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Beyond Discrimination: Evaluating Probability Calibration in Radiomics-Image Fusion for Renal Cell Carcinoma Classification

Reliable probability estimates are important for the clinical interpretation of machine-learning classifiers, yet radiomics--image fusion models for renal cell carcinoma (RCC) are commonly evaluated primarily by discrimination. Using 396 patients from the KiTS23 dataset, we evaluated whether adding radiomics to four im...

Yuan Liang, Morgan May, Abraham Campbell et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

PLDiv: Measuring Dataset Diversity and Semantic Collapse via Persistence Landscapes

Modern data pipelines increasingly combine human-created and human-curated data with AI-generated data for model training and evaluation. As datasets grow, they often add semantically redundant samples rather than expanding semantic coverage, which deteriorates the quality of the whole dataset. Existing diversity metri...

Yang Ba, Michelle V. Mancenido, Rong Pan · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Barycentric Anchored Weight Search for Robust Model Merging

We propose Barycentric Anchored Search, a post-hoc weight-space procedure for improving fine-tuned vision models under distribution shift without additional gradient training or increased inference cost. Given a pre-trained initialization and two checkpoints fine-tuned on a source dataset, the method constructs barycen...

Antoni Buades, Jose-Luis Lisani · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.