Skip to content

Category

computer vision

3,920 papers

#artificial intelligence Preprint Sep 2026

VISTA-Bench: Benchmarking Multilingual Image Translation with Image-Specific Rubrics

Image translation is a fundamental capability of multimodal models for multilingual applications, requiring visual understanding and meaning preservation across languages. However, existing benchmarks have limited language coverage and often lack explicit image-specific evaluation criteria, making it difficult to compr...

Bo Lv, Mao Zheng, Zheng Li et al. · 0 citations
#artificial intelligence Preprint Sep 2026

UniAfford: Token-Routed Multitask Learning for Generalizable 2D-3D Affordance Perception

Affordance perception aims to localize actionable regions supporting embodied interaction, yet 2D and 3D affordance grounding have evolved as separate problems, with different task definitions, supervision formats, datasets, and evaluation protocols. This fragmentation limits the learning of transferable object-afforda...

Yu-Hao Liu, Yi-Ming Zhong, Han-Qing Wang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Codebook-Guided Cross-Modal Knowledge Distillation for Structurally Heterogeneous Features

A cross-modal distillation framework that enables effective knowledge transfer across structurally heterogeneous feature spaces via a vector-quantized codebook, and the selected codes serve as concept-level anchors for student learning is proposed.

D. Jo, Jongin Lim, YoungJoon Yoo et al. · 0 citations
#artificial intelligence Preprint Sep 2026

ResComEmb: Effective and Efficient Multimodal Embedding via Residual Homogeneity Compression

ResComEmb is proposed, a trainable framework for effective and efficient universal multi-vector multimodal embedding that produces higher-quality universal multimodal embeddings than VLM2Vec-V2, and outperforms ColQwen2.5 in visual document retrieval.

Zi-Jing Cai, Yu-Zhe Wang, Jing-Xian Zhu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

NowcastDiT: Diffusion Transformers are Effective Precipitation Nowcasters

This work develops NowcastDiT and instantiates this flexibility through two complementary adaptations: a dynamics-aware noise prior for temporally coherent forecasts, and end-to-end reinforcement learning with timestep-aware rewards for meteorological skill.

Hao-Ran Xu, Xing-Zhuo Guo, Yu-Chen Zhang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videos

Despite rapid progress in video generation models, they still exhibit obvious motion deficiencies, often manifested as incorrect object motion. However, most existing video quality evaluations focus on aesthetic quality or text-video alignment. To address this gap, we study object-centric motion fidelity assessment, ev...

Jia-Hao Zhan, Yong-Rui Ma, Qunliang Xing et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Embedded Bi-Temporal Building Damage Assessment for On-Board Data Reduction

A latent-space shift estimation and correction module that regresses the global offset from the coarse feature level and realigns the post-disaster features before fusion substantially improves robustness to de-registration while also raising nominal accuracy and remaining compatible with the strongest compression.

Thomas Goudemant, B. Francesconi, Marjorie Bellizzi et al. · 1 citation
#artificial intelligence Preprint Open access Sep 2026

Visual Parallel Search: Learning to Search High-Resolution Images with Parallel Tile Inspection and Adaptive Zoom

High-resolution visual question answering often fails because a multimodal model does not acquire the small, spatially localized evidence needed to answer a question. Sequential zooming can recover detail, but it asks the main model to choose a region before obtaining a reliable overview. We introduce VPS, a visual par...

Xijia Tao, Yihua Teng, Xinyu Fu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Parameterized Stripe Attention for Efficient Video Generation

PSA, a parameterized stripe attention that formalizes the observed stripe regularity, unifying diverse attention patterns for efficient mask generation, enables a single hardware-efficient CUDA kernel to process all sparse patterns, achieving FlashAttention-3-level Model FLOPs Utilization.

Xing-Yu Jia, Bao-Le Ai, Ang Wang et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Salt++: Context-Aligned Post-Training for Few-Step Streaming Multimodal Generation

Few-step streaming audio--video generation requires both causal modeling and step distillation, yet standard training recipes face two context-related challenges. Teacher forcing pairs clean history with a noisy target, but supervises predictive contextual representations only indirectly through velocity prediction. Me...

Xingtong Ge, Yutong Wang, Lunjie Zhu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

WeLike2Party! In-Context Motion Transfer for Multi-Human Image Animation

Human image animation aims to transfer motion from a driving video to subjects in a reference image. Despite remarkable progress in video generation, achieving high-fidelity animation of multiple interacting subjects remains a challenge. Many existing approaches rely on explicit motion representations such as 2D skelet...

Sangeyl Lee, Seunghyun Shin, S. Park et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.