Skip to content

Category

computer vision

3,687 papers

#artificial intelligence Preprint Open access Oct 2026

Understanding Transformer-based Vision Models through Inversion

Understanding the internal mechanisms of deep neural networks remains a central challenge in machine learning. In computer vision, one promising yet only preliminarily explored approach is feature inversion via inverse networks, which reconstructs images from intermediate representations using trained inverse networks....

Jan Rathjens, Shirin Reyhanian, David Kappel et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Conditional Vendi Score: Prompt-Aware Diversity Evaluation for Generative AI Models and LLMs

Generative models guided by text prompts are widely evaluated for fidelity and prompt alignment, yet their ability to produce diverse outputs remains underexplored. Existing diversity metrics such as Vendi and RKE, which are based on the von Neumann and R\'enyi entropies of kernel matrices, were developed for unconditi...

Mohammad Jalali, Azim Ospanov, Amin Gohari et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Hide and Seek: HIDE Concepts to SEEK explanations for black box models

Interpreting machine learning model predictions is a central challenge, particularly for black-box vision models. Concept-based attribution methods interpret models using human-understandable concepts. Existing concept-based methods can only interpret classification and regression models. They require access to model w...

Bhanu Tokas, Rahul Nair, Rockwell Jackson et al. · 0 citations
#artificial intelligence Preprint Oct 2026

SpatialASM: Internalizing Active Mentalization for Spatial Reasoning

When solving complex spatial reasoning tasks, ordinary humans naturally revisit the scenes from task-relevant viewpoints and mentally reconstruct the spatial layouts from those viewpoints. But can Large Vision-Language Models (LVLMs) proactively think in the same way? We term this ability Active Spatial Mentalization (...

Yuhong Liu, Shen-Xi Wu, Jun-Yi Chi et al. · 0 citations
#artificial intelligence Preprint Oct 2026

LAPT-Scale: Scaling Embodied Policies with Latent Action Pre-Training on Human Videos

Scaling generalist robotic policies is limited by the high cost of collecting embodied interaction data. Large-scale egocentric human videos offer a rich alternative, but they lack robot action labels, and existing action annotation methods are often noisy under real-world visual complexity and diverse manipulation dyn...

Zhi-Yuan Xiang, Pei-Dong Liu, Ming-Yang Li et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Model-agnostic Knowledge Augmented Machine Learning for Weakly Annotated Bioimaging Data

Machine learning models are increasingly used for automated feature extraction from weakly annotated bioimaging data, such as microscopy and cytomorphology images. Due to the sole dependency of automated feature extraction, existing methods yield inconsistent classification performance across weakly annotated datasets....

Jayanie Bogahawatte, Sachith Seneviratne, Simon Maksour et al. · 0 citations
#artificial intelligence Preprint Oct 2026

When MLLMs miss what humans read: diagnosing and learning to read squint text

Multimodal LLMs can fail to read text embedded in an image's coarse structure (text a human recovers by squinting) and report that no text is present. We name this class Squint Text and study it as a recognition deficiency, motivated by cases from a production moderation pipeline. We introduce SquintBench, comprising 1...

Chen Peng, Shang-Qing Huang, Jian-Bo Huang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Evolving Creatives with Clicks: CTR-Driven Advertising image Editing via Attribute Disentanglement and Preference Alignment

The optimization objective for e-commerce advertising creatives has shifted from aesthetic quality to online business metrics like click-through rate (CTR). Recent methods generate appealing ad images from product images by constructing CTR-based reward signals and refining prompt generation via Reinforcement Learning....

Xu Zhang, Haohan Wang, Zheng Zhang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

GeoGR: Spatial-Semantic Token Compression and Group Routing for Efficient 3D VLMs

Multi-view representations enable pretrained image and video vision-language models to understand 3D scenes, but their long visual token sequences make inference costly. Redundancy arises both from repeated observations of the same scene regions across views and from processing all visual tokens at every LLM layer, reg...

Yong-Xing Zheng, Hao Wu, Fang Li et al. · 0 citations
#artificial intelligence Preprint Oct 2026

The Evidence Anchoring Boundary: Where Visual Interventions Matter and When They Help in Multimodal LLMs

Visual interventions provide a training-free way to reduce hallucinations in multimodal large language models. However, an intervention may have little leverage at some layers and may damage a correct answer even when it changes the output. We investigate where visual interventions retain leverage and when they improve...

Qi-Ji Zhou, Jun-Yi Hu, Pei-Yu Wang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing

Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Beyond general scenarios, professional motions are significant in performance, sports, and martial arts. This paper focuses on professional motion editing, which involves fi...

Si-Yi Qian, Han-Qing Yang, Wei-Huang Lin et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Unsupervised Multimodal Reward Modeling

Vision-language reward models are trained on annotated preference pairs, which are expensive to collect, can disagree, and are ranked by benchmark accuracy. We build one with no human preference label: a linear head on an intermediate layer of a frozen Qwen3-VL backbone, trained to score a web caption above a perturbed...

Yue-Ying Li, Jing-Xuan Fan, Kianté Brantley et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.