Skip to content

Category

computer vision

3,560 papers

#machine learning Preprint Open access Oct 2026

A Language-Informed Loss for Visual Generation

End-to-end visual generation with pixel-space loss has recently achieved competitive performance without the need for learned image tokenizers. In this work, we study whether language-informed supervision can provide a richer training signal than pixel loss for visual generation. We introduce LILIE (pronounced "lily"),...

Suchir Agarwal, Keshigeyan Chandrasegaran, Ziyu Chen et al. · 0 citations
#machine learning Preprint Oct 2026

Look, Reason, Draw a Region: Recursive Refinement for Spatial Context Prediction

Spatial context prediction requires visual grounding and spatial reasoning to identify vacant regions relative to objects in a scene. Spatial relationships and physical constraints remain challenging for large vision-language models (VLMs). Recursive reasoning has demonstrated strong performance on discrete and abstrac...

Wajeeha Tahir, Anna Tegon, Lionnus Kesting et al. · 0 citations
#machine learning Preprint Open access Oct 2026

The Optimal Ranking Tradeoffs Between Two Ranking Scores in Two-Class Classification

The accuracy, true negative rate (negative class recall), true positive rate (positive class recall), negative predictive value (negative class precision), positive predictive value (positive class precision), class-specific intersections over unions, class-specific F-scores, Cohen's kappa, and balanced accuracy are sc...

S\'ebastien Pi\'erard, Adrien Deli\`ege, Marc Van Droogenbroeck · 0 citations
#machine learning Preprint Open access Oct 2026

Can the Parts Fool the Test? Counterfactual Pairing Cycles for Relational OOD

Relational out-of-distribution errors are easy to describe and hard to evaluate cleanly. An image may be natural, a caption may be fluent, and all mentioned objects may be common, yet the caption may describe the wrong relation in the image. Many evaluations intended to test this behavior can be solved without checking...

Yibo Zhou, Yirong Xiang · 0 citations
#machine learning Preprint Oct 2026

How Murky Before a VLM Knows It Cannot See? Accuracy, Confidence and Abstention on a Physical Visibility Axis

Robustness studies of vision-language models (VLMs) grade degradation on nominal severity scales ("level 1-5") that carry no physical units, and they rarely ask whether a model's confidence follows the loss of visibility. We measure accuracy, internal (token-probability) confidence, verbalized confidence and an explici...

Mochamad Rizal Fauzan, Irgi Surya · 0 citations
#machine learning Preprint Open access Oct 2026

Replay Pruning and Few-Bit Integer Inference for Hardware-Efficient Speed-Sign Recognition

Speed-limit sign recognition on an automotive camera system-on-chip (SoC) must fit a detector and a classifier (the reader) into the memory, arithmetic, and energy budgets of the device. In our two-stage recognizer, the detector, a YOLO-family network with ReLU and hard-sigmoid operators, is compressed by channel repla...

Se Un Park, Kyungkeon Chung, Huigeol Kim et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Is a Linear Probe Evidence of a Linear Representation?

The linear representation hypothesis holds that pretrained vision models encode generative factors as linearly decodable directions in feature space, and comes with a standard methodology: train a linear probe, declare a factor represented if accuracy is high. We show this test is too permissive. Asymptotically, any su...

Nadir Kutluozen, Christian Intern\`o, David Klindt · 0 citations
#machine learning Preprint Oct 2026

Shift-Reliance Alignment: Ranking Vision-Language Models by the Cues They Trust

Vision-language models (VLMs) are usually chosen from leaderboards, which give one ranking for every application. On questions about objects that a scene suggests but does not contain, however, the model with the lowest error on the POPE hallucination benchmark is not the one with the lowest error on such questions. Fo...

Faisal Mohammad, M. Younis · 0 citations
#machine learning Preprint Open access Oct 2026

Learning the Shared Latent Structure of Cryo-EM Inverse Problems

Understanding biomolecular function requires characterizing three-dimensional structure and conformational variability, for which cryogenic electron microscopy (cryo-EM) is a powerful tool. Cryo-EM produces noisy two-dimensional particle images in which molecular structure, particle pose, and imaging conditions are joi...

Nithin Chalapathi, Theo Sternlieb, Ethan Han et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Towards Reconstructing Geographically Diverse Architecture with 3D Foundation Models

Internet-scale photo collections of real-world landmarks have driven progress in 3D computer vision yet remain highly challenging for modern 3D foundation models (3DFMs) that estimate scene structure in a single feed-forward pass. In this work, we introduce ArchWorld, a benchmark of 3D architectural landmarks with high...

Nicky Kriplani, Yiwen Zhang, Angelina Wang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Has GPT-6-Astra Achieved Embodied Intelligence?

GPT-6-Astra demonstrates a level of competence in robotic manipulation and navigation that challenges the conventional paradigm of building specialized models for individual tasks and embodiments. In this report, we ask not only how capable GPT-6-Astra is, but what its capabilities imply for the field. First, we probe...

SenseNova, Joint Research Team, : et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Domain-specific language alignment of multimodal embeddings towards explainable predictions

Multimodal data are commonly fused into latent representations that improve downstream task performance but are not interpretable, limiting their application in domains that require explainable model decisions. Vision-language alignment has made image embeddings interpretable through language, but requires vast image-c...

Gabriel\.e Tij\=unaityt\.e, Thijs L. van der Plas, Mohamed-Bachir Belaid et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.