Image translation is a fundamental capability of multimodal models for multilingual applications, requiring visual understanding and meaning preservation across languages. However, existing benchmarks have limited language coverage and often lack explicit image-specific evaluation criteria, making it difficult to compr...
Affordance perception aims to localize actionable regions supporting embodied interaction, yet 2D and 3D affordance grounding have evolved as separate problems, with different task definitions, supervision formats, datasets, and evaluation protocols. This fragmentation limits the learning of transferable object-afforda...
Yu-Hao Liu, Yi-Ming Zhong, Han-Qing Wang et al.· 0 citations
P predictive visual latents are established as a foundation for effective WAM learning from task-specific demonstrations and for transferring future-modeling knowledge acquired from broader in-the-wild videos.
Yang Zhang, Jiang-Yuan Zhao, Chen-You Fan et al.· 3 citations
A cross-modal distillation framework that enables effective knowledge transfer across structurally heterogeneous feature spaces via a vector-quantized codebook, and the selected codes serve as concept-level anchors for student learning is proposed.
D. Jo, Jongin Lim, YoungJoon Yoo et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
ResComEmb is proposed, a trainable framework for effective and efficient universal multi-vector multimodal embedding that produces higher-quality universal multimodal embeddings than VLM2Vec-V2, and outperforms ColQwen2.5 in visual document retrieval.
Zi-Jing Cai, Yu-Zhe Wang, Jing-Xian Zhu et al.· 0 citations
This work develops NowcastDiT and instantiates this flexibility through two complementary adaptations: a dynamics-aware noise prior for temporally coherent forecasts, and end-to-end reinforcement learning with timestep-aware rewards for meteorological skill.
Hao-Ran Xu, Xing-Zhuo Guo, Yu-Chen Zhang et al.· 0 citations
Despite rapid progress in video generation models, they still exhibit obvious motion deficiencies, often manifested as incorrect object motion. However, most existing video quality evaluations focus on aesthetic quality or text-video alignment. To address this gap, we study object-centric motion fidelity assessment, ev...
Jia-Hao Zhan, Yong-Rui Ma, Qunliang Xing et al.· 0 citations
A latent-space shift estimation and correction module that regresses the global offset from the coarse feature level and realigns the post-disaster features before fusion substantially improves robustness to de-registration while also raising nominal accuracy and remaining compatible with the strongest compression.
Thomas Goudemant, B. Francesconi, Marjorie Bellizzi et al.· 1 citation
High-resolution visual question answering often fails because a multimodal model does not acquire the small, spatially localized evidence needed to answer a question. Sequential zooming can recover detail, but it asks the main model to choose a region before obtaining a reliable overview. We introduce VPS, a visual par...
Xijia Tao, Yihua Teng, Xinyu Fu et al.· 0 citations
PSA, a parameterized stripe attention that formalizes the observed stripe regularity, unifying diverse attention patterns for efficient mask generation, enables a single hardware-efficient CUDA kernel to process all sparse patterns, achieving FlashAttention-3-level Model FLOPs Utilization.
Xing-Yu Jia, Bao-Le Ai, Ang Wang et al.· 0 citations
Few-step streaming audio--video generation requires both causal modeling and step distillation, yet standard training recipes face two context-related challenges. Teacher forcing pairs clean history with a noisy target, but supervises predictive contextual representations only indirectly through velocity prediction. Me...
Xingtong Ge, Yutong Wang, Lunjie Zhu et al.· 0 citations
Human image animation aims to transfer motion from a driving video to subjects in a reference image. Despite remarkable progress in video generation, achieving high-fidelity animation of multiple interacting subjects remains a challenge. Many existing approaches rely on explicit motion representations such as 2D skelet...
Sangeyl Lee, Seunghyun Shin, S. Park et al.· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.