Skip to content

Category

computer vision

3,798 papers

#machine learning Preprint Sep 2026

MotionWeave: Learning Motion-Centered Future Dynamics for Vision-Language-Action Policies

Vision-Language-Action (VLA) models have recently incorporated world models to provide richer dynamic supervision beyond sparse action labels. However, explicitly predicting future images or videos may include control-irrelevant appearance, while guidance derived from holistic future visual representations and shared g...

Jing-Qi Wang, Yan Wang · 0 citations
#machine learning Preprint Sep 2026

Fiber-Resolved Microstructure Quantification from Multi-Shell Diffusion MRI using Detection Transformers

This work proposes to reframe the diffusion MRI problem as an object detection-like task, adopting the Detection Transformer (DETR) architecture to jointly predict mean diffusivity, fractional anisotropy, main fiber direction, and signal fraction for a variable number of compartments per voxel from standard multi-shell...

Sebastian Endt, Marcus Wirth, Johannes Reinhold Schlund et al. · 0 citations
#machine learning Preprint Open access Oct 2026

BadAction: Backdoor Attacks on Interactive Video Generation via Action-Guided Triggers

Interactive video generation (IVG) models have achieved remarkable progress in producing controllable visual content guided by user-defined actions, yet their security vulnerabilities remain largely unexplored. In this paper, we present the first systematic study of backdoor attacks against the interactivity of IVG mod...

Zhihang Wu, Zhongqi Wang, Jie Zhang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

DCM-SAM: Defect-Conditioned Mixture of LoRA Experts for NPU-Deployed AM Defect Segmentation

Metal additive manufacturing parts are inspected by X-ray computed tomography, where labelled data is scarce, the pores and inclusions that matter span a few pixels, and inspection must happen at the machine. We present DCM-SAM, a defect-conditioned adaptive mixture of LoRA experts: one frozen Segment Anything backbone...

Md Mushfiqur Rahaman, Md Mahedi Hasan, Imtiaz Ahmed et al. · 0 citations
#machine learning Preprint Sep 2026

Recovering Off-Policy Supervision for Speculative Decoding

A rollout-based training framework that recovers full supervision through two complementary components, Anchor-Label Relabelling (ALR) and In-Rollout Anchors (IRA), that increases greedy accepted length by up to 36.5% over DFlash and consistently outperforms erasing baselines.

Jungseob Lee, Chanjun Park, Sugyeong Eo et al. · 1 citation
#machine learning Conference Open access Sep 2026

STEPS: Scene Text Editing with Preserved Style Using Diffusion and Contrastive Style Encoding

We introduce Scene Text Editing with Preserved Style (STEPS), a novel diffusion model architecture for quality text replacement in images. Scene Text Editing (STE), also known as Visual Text Editing, consists of changing the textual content in an image while conserving the original style, e.g. font, colors, orientation...

Nicolas Thiébaut, Nameer Hirschkind, Xiao Yu et al. · 0 citations
#machine learning Preprint Sep 2026

Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidance

While Vision-Language-Action (VLA) models enable flexible action generation, their generalization across diverse environmental elements, including manipulated objects, destinations, and backgrounds, is limited by the lack of diversity in robotic training data. Trained end-to-end on such data, VLAs tend to exploit visua...

Yan-Yan Zhang, Di-Sheng Liu, Xin-Peng Li et al. · 0 citations
#machine learning Preprint Sep 2026

GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction

Egocentric gaze prediction enables many downstream applications but remains challenging, as human gaze is inherently stochastic. This stochasticity is constrained by structured temporal dynamics alternating between fixations and saccades, top-down influences from tasks, and bottom-up visual saliency. Based on this obse...

Sheng Zhao, Wei-Kai Lin, Yu-Hao Zhu · 0 citations
#machine learning Preprint Open access Oct 2026

Beyond Layers: Position-Resolved Gradient Conflict and Position-Aware Modulation for Unified Multimodal Models

Unified multimodal models (UMMs) train image understanding and autoregressive image generation on shared parameters, and the two objectives are known to interfere. Existing diagnoses and remedies operate at the resolution of layers or experts, measuring conflict per layer and resolving it by separating parameters. We a...

Shuyang Jiang, Fucheng Deng, Yuchuan Luo et al. · 0 citations
#machine learning Preprint Sep 2026

It Takes Little to Rewrite Perception: Targeted Semantic Substitution in Vision-Language Models at $\epsilon \leq 4/255$

Vision Language Models (VLMs) are widely deployed in safety-critical scenarios, and understanding to which extent they can be controlled by adversarial perturbation is a prerequisite for evaluating their trustworthiness. Existing representation-alignment attacks, which make a VLM perceive a target image, achieve limite...

Binchi Zhang, Atrisha Sarkar, Apurva Narayan · 0 citations
#machine learning Preprint Open access Oct 2026

Ranking-Aware Prompt Optimization for Multimodal Clinical Diagnosis

Multimodal large language models (MLLMs) are rapidly advancing clinical diagnosis, yet their adaptation pipelines remain anchored to accuracy-based objectives. Clinical data are heavily class-imbalanced: a constant-majority predictor can score above 90% accuracy while being clinically useless. We therefore evaluate and...

Tian Xia, Minghao Liu, Yiqing Liang et al. · 0 citations
#machine learning Preprint Sep 2026

Prototype-Rule Neurosymbolic Regularization for Rank-Constrained Tensor Neural Networks under Label Scarcity

Rank-constrained tensor neural networks reduce the parameterization of high-order inputs, but they do not explicitly constrain class geometry in the learned representation. This study investigates whether a differentiable prototype-rule can provide a complementary inductive bias for Rank-R tensor learning under limited...

Eftychios Protopapadakis, Konstantinos Makantasis, Konstantinos M. Giannoutakis · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.