The design, integration, and field deployment of an AI-assisted collaborative inspection cell at the Silverline kitchen-appliance factory is presented, developed within the AI-PRISM project.
Asya Ünal, Amr Okasha, Ege Çirakman et al.· 0 citations
A Wizard-of-Oz study design and supporting real-time system for collecting multimodal behavioral data from native Chinese speakers reacting to social norm violations by German learners.
Siddhant Jain, Anna Lea Reinwarth, Dimitra Tsovaltzi et al.· Companion Publication of the...· 1 citation
The rapid growth of online video platforms and AI-generated content has made reliable video guardrails a key challenge for safety and real-world deployment. While most videos can be screened through fast pattern recognition, a small subset requires deeper reasoning over temporally complex content and nuanced policy con...
Shahriar Kabir Nahin, Hadi Askari, Muhao Chen et al.· 0 citations
In this work, we examine hateful memes from three complementary angles - how to detect them, how to explain their content and how to intervene them before being posted - by applying a range of strategies built on top of generative AI models. To the best of our knowledge, explanation and intervention have typically been...
Naquee Rizwan, Subhankar Swain, Paramananda Bhaskar et al.· 4 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work presents, to their knowledge, the first simultaneous sign-to-sign (S2S) translation system, with two wait-k regimes: test-time wait-k inference applied directly to a full-sentence model, and a trained wait-k model via stochastic multi-path supervision.
Ze-Tian Wu, Bo-Wen Xie, Stefan Lee et al.· 0 citations
ColNanoVDR is presented, to the authors' knowledge the first framework to bring this document-free distillation to multi-vector VDR, and it is proved that the resulting alignment cost bounds the MaxSim score difference on every page.
Multimodal foundation models edit natural photographs at production quality, yet the same models struggle with structured visual content such as infographics. Unlike photographs, infographics encode information through logical relations; editing one element often requires surrounding elements to be adapted. We refer to...
Cheng Yang, Chu-Fan Shi, Hui-Juan Wang et al.· 0 citations
The upshot is that a large share of the apparent CAAP--SNAP gap traces back to closed-category annotation limits rather than a real grounding failure, which matters for how the authors detect hallucination, analyze failure modes, and design evaluation for grounded multimodal systems meant to work in the open world.
Frequency BPE achieves stronger raw compression, while MDL-SG achieves lower BPC, showing that compression-oriented merge selection and language-model utility need not coincide.
High instance-level accuracy can mask inconsistencies in spatial reasoning when objects exchange positions or their roles are reversed in the query. The internal representations supporting relative-position reasoning remain poorly understood. We investigate two complementary components of this process: tracking object...
Yingjin Song, Denis Paperno, Albert Gatt· 0 citations
To enable bidirectional mapping between text and sign, SignFLIP adopts a symmetric architecture together with a stage-wise training strategy built on large-scale data, which shows competitive performance compared with task-specific models on both translation and generation tasks, as well as strong transferability to si...
Zhaoyi An, Si-Han Tan, Youngbae Hwang et al.· 0 citations
This work introduces InfiMed2, a family of 4B and 27B generalist medical multimodal foundation models built around stage-aware data design, and curates a 55.68B-token corpus that combines broad clinical knowledge with context-rich biomedical visual evidence through source-specific processing.
Guang-Hao Zhu, Ze-Yu Liu, Zhitian Hou et al.· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.