Skip to content

Category

computer vision

4,009 papers

#machine learning Preprint Aug 2026

Correcting Learning-based Perception for Safety

A two-step strategy for correcting ML-based state estimation, where an offline computation is used to characterize the uncertainties resulting from the ML module's state estimation, using preimages of perception contracts at runtime, using a risk heuristic.

Yan Miao, Hussein Darir, Sayan Mitra · 0 citations
#machine learning Preprint Aug 2026

PRQuant: Permutation Residual Quantization for Low-Overhead Inference

Experiments show that PRQuant substantially reduces down-projection reconstruction error, with scaling and residual compensation providing the main numerical gains while permutation enables a hardware-friendly contiguous layout.

Pei-Ran Wang, An-Qi Wang, Jia-Ying Zhao et al. · 0 citations
#computer vision Preprint Jun 2026

Traits Run Deeper: Trait-Specific Asymmetric Fusion for Multimodal Personality Assessment

Experimental results on the AVI Challenge 2026 validation set show that this framework reduces mean squared error (MSE) by approximately 25% compared with the baseline, and consistent improvements on the official test set demonstrate that the method achieves the best performance.

Jia Li, Qian-Cheng Chen, Wei Wang et al. · 0 citations
#computer vision Preprint Sep 2026

Learned Parametric Emotion Editing: Real-Time Affective Filtering for On-Device Social Media Video

A model that predicts this transformation in a single forward pass is learned: a MobileNetV4 backbone with FiLM-based emotion conditioning outputs parameters for differentiable global transformations, which reduced viewer-reported arousal relative to unedited images, comparably to the grayscale well-being filter.

Musa Rochi, Marcel Schubert, Christoph Gebhardt · 0 citations
#computer vision Preprint Sep 2026

RobotEQ-Video: A Video-Centric Benchmark for Social Proactive Intelligence with World-State Taxonomy

This work advances SPI research from static images to dynamic videos and ensures more comprehensive scenario coverage during benchmarking with RobotEQ-Video, a hierarchical world-state taxonomy organized into a four-level coarse-to-fine structure.

Xin-Yi Che, Zheng Lian, Kuo-Fei Fang et al. · 2 citations
#computer vision Preprint Sep 2026

Evaluating In-Context Learning and Retrieval Strategies for Devanagari Post-OCR Correction

CharBM25 is established as an effective, GPU-free retrieval strategy that matches or exceeds dense retrieval at negligible computational cost, and combining it with a general-purpose LLM of 12B+ parameters delivers reliable, training-free Devanagari post-OCR correction without task-specific fine-tuning.

Abhishek Bhandari, Gaurav Harit · 0 citations
#computer vision Preprint Sep 2026

Omni Demand Understanding: A Benchmark for Contextual User-Intent Inference in Multimodal Interaction

Omni Demand Understanding is established as a distinct multimodal contextual inference problem: given an interaction stream, a model must detect whether a user demand is present and infer intent from multimodal and conversational context, and ODU is evaluated along five dimensions, covering both single-turn and multi-t...

Qi Chen, Yun-Fei Chu, Haolin He et al. · 1 citation · ⚡1
#computer vision Preprint Aug 2026

MME-Safety: A Fine-grained Benchmark for Safety Evaluation of MLLMs

This work proposes MME-Safety, a rigorously verified benchmark featuring a unique four-dimensional annotation schema that categorizes risk scenarios, harm severity, and modality-specific stealth levels and introduces a hierarchical evaluation framework to assess fundamental response reliability, actual risk exposure, a...

Yi Shi, Yueming Lyu, Hao-Xiang Tan et al. · 0 citations
#computer vision Preprint Jul 2026

Curriculum-Based Noise Adaptation for Phoneme-to-Text Reconstruction in Visual Speech Recognition

PECT consistently improves reconstruction performance across multiple phoneme-based visual speech recognition frontends, including visual automatic speech recognition (V-ASR), point visual automatic speech recognition (PV-ASR), and head-pose-aware visual speech recognition (HP-VSR) variants.

Matthew Kit Khinn Teng, Hai-Bo Zhang, Takeshi Saitoh · 0 citations
#machine learning Open access Jun 2025

CASE: Contrastive Activation for Class-Sensitive Explanations

This work proposes a diagnostic test for class sensitivity: a method’s ability to distinguish between competing class labels on the same input, and introduces CASE, a contrastive explanation method that isolates features uniquely discriminative for the predicted class.

Dane Williamson, Yang-Feng Ji, Matthew B. Dwyer · 1 citation

Geometry-Aware Reinforcement Learning for 2D Irregular Nesting

This paper introduces the Polygons Transformer (PoT), a novel architecture that encodes 2D continuous vector geometries while allowing cross-polygon attention and couple this novel architecture with a Combinatorial Optimization Reinforcement Learning (CORL) training framework to find optimal solutions.

Auguste Lehuger, Guillaume Henon-Just · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.