Skip to content

Category

computer vision

4,009 papers

#artificial intelligence Open access Mar 2025

BGM2Pose: Active 3D Human Pose Estimation With Non-Stationary Sounds

BGM2Pose is proposed, a non-invasive 3D human pose estimation method using pre-selected everyday music as active sensing signals and a Frequency-wise Attention Module that enables the model to focus on subtle acoustic variations attributable to human movement by dynamically computing attention across frequency bands.

Yuto Shibata, Yusuke Oumi, Go Irie et al. · 1 citation
#artificial intelligence Preprint Open access Sep 2026

EventVL: Understand Event Streams via Multimodal Large Language Model

The event-based Vision-Language Model (VLM) recently has made good progress for practical vision tasks. However, most of these works just utilize CLIP for focusing on traditional perception tasks, which obstruct model understanding explicitly the sufficient semantics and context from event streams. To address the defic...

Pengteng Li, Yunfan Lu, Pinghao Song et al. · 0 citations
#artificial intelligence Preprint Jul 2026

SportD: How do VLMs physically strategize?

SportD opens a new direction for rigorously evaluating physical strategic decision-making in VLMs, showing that careful decomposition of their choices can reveal the mechanisms underlying systematic biases such as risk aversion.

Jasin Cekinmez, Addison J. Wu, Hao-Tian Xia et al. · 0 citations
#artificial intelligence Preprint Dec 2025

Echo-CoPilot: A Multiple-Perspective Agentic Framework for Reliable Echocardiography Interpretation

Echocardiography interpretation requires integrating multi-view temporal evidence with quantitative measurements and guideline-grounded reasoning, yet existing foundation-model pipelines largely solve isolated subtasks and fail when tool outputs are noisy or values fall near clinical cutoffs. We propose Echo-CoPilot, a...

Moein Heidari, Ali Mehrabian, M. A. Roohi et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Anatomical Grounding and Leakage-Aware Multimodal Contrastive Learning for Alzheimer's Disease Classification from Structural MRI

Deep networks trained on structural MRI for Alzheimer's disease (AD) staging often reach reasonable accuracy while attending to anatomically irrelevant regions, and multimodal models that add clinical tables frequently rely on variables that were used to assign the diagnostic label in the first place. We study both iss...

Paul-Gabriel Nicolae, I. Mocanu · 0 citations
#artificial intelligence Preprint Sep 2026

Don't Send What You Don't Need: Question-Guided Token Pruning as a Privacy Defense for Vision-Language Models

Visual Question Answering (VQA) with Vision-Language Models (VLMs) is increasingly used in privacy-sensitive and bandwidth-constrained settings. Federated Learning (FL), Split Learning (SL), and U-Shaped Split Learning (USL) keep raw data local, but transmitting all visual tokens across a model partition remains costly...

Md. Khalid Syfullah, Alvi Ataur Khalil · 0 citations
#artificial intelligence Preprint Sep 2026

Benchmarking Intra-Patient 3D Deformable Multimodal Image Registration

Multimodal image registration is a key component of many clinical workflows, yet it remains challenging because corresponding anatomical structures often exhibit substantially different image intensities across modalities. In this work, we present a comprehensive benchmark of intra-patient 3D multimodal deformable regi...

Matteo Barbieri, G. La Barbera, J. De la Plata et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Circuit-MLLM: Topological Logic-Guided Latent-Space Visual Reasoning for Circuit Schematic Understanding

Through pre-training on extensive text and image datasets, current multi-modal large language models (MLLMs) achieve strong performance on general tasks. However, circuit schematics present a unique challenge for MLLMs due to their dense component layouts and distinct topological logic, demanding fine-grained structura...

Jinyuan Deng, Yuqi Jiang, Wenjing Huang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

KaiNinja: Extending Native 3D Generators to the Part Level

KaiNinja, a part-level extension of TRELLIS.2 built on a dual-volume form of its O-Voxel representation, is the first 3D generative model trained on agent-authored part data and finds that whole-object fidelity improves over the same backbone fine-tuned on the same dataset.

Rui-Han Yu, Lian Fu, Mu-Yao Niu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Through the Eyes of the Beholder: Biometric and Demographic Conditioning for Multimodal Sexism Detection

The VANGUARD team proposes a human-centered multimodal framework that analyses and incorporates the psychological and demographic characteristics of human annotators into the detection pipeline and releases the full pipeline and analysis to support reproducible human-centered modeling.

A. Mocanu, Sebastian Mocanu, Ciprian-Octavian Truica et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.