C3M is presented, a cross-session multimodal memory organization that maintains a bounded active index over persistent source text-image evidence in a bounded, query-blind memory budget for cross-session long-horizon tasks.
Xue-Shu Chen, Yan Wang, Zi-Hao Xue et al.· 0 citations
Chest radiographs are routinely used to verify the position of catheters, tubes, and other support devices. Existing image models often return labels or segmentations, while report-processing systems structure text without access to image geometry. We present an uncertainty-aware clinical knowledge graph that represent...
This work introduces WROP (World Reasoning with Object Permanence), a data infrastructure of 150 hand-designed cognitive science inspired tasks, divided into six cognitive categories, and builds Blender generators that randomize speed, lighting, camera angle, and other nuisance parameters while preserving each task's c...
Hao-Tian Zhang, Feng-Yuan Yu, Dezhi Luo et al.· 0 citations
This work proposes Interleaved Distillation and Reinforcement Learning (IDRL), a novel post-training paradigm that tightly integrates on-policy distillation and reinforcement learning within a single training loop and enables more effective knowledge transfer, greater optimization stability, and more precise credit ass...
Heyu Chen, Xiao-Han Lan, Jia-Xin Li et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
ART is a tool-injection framework that tunes any VLA model to leverage off-the-shelf tool modules for low-level vision, high-level affordance, and embodiment enhancement, and ART reduces the complexity of the action solution space through tool-use, which improves generalizability across different tasks but also reduces...
Ding-Ge Yi, Yanzhao Yu, Xi-Li Dai et al.· 1 citation
This work re-examines the distillation procedure through the theoretical lens of Information Theory, formally modeling it as a dynamic mutual information game constrained by the Information Bottleneck (IB) principle, and dismantle traditional blind assumptions via a dual-track adaptive framework.
EA-WM is presented, an Event-Aware Generative World Model that effectively closes the loop between kinematic control and visual perception, and introduces event-aware bidirectional fusion blocks that modulate cross-branch attention, capturing object state changes and interaction dynamics.
A Target-Aware Frequency-Spatial Collaborative Enhancement (FSCE) framework for noise-resilient SAR ATR, which integrates frequency-spatial modeling for early feature stabilization with semantic regularization and an Adaptive Policy-driven Semantic Alignment mechanism.
Yan-Song Lin, Zi-Han Cheng, Zi-Yue Yang et al.· IEEE transactions on circuit...· 0 citations
This work presents AwaRes, a spatial-on-demand framework that resolves this accuracy-efficiency trade-off by operating on a low-resolution global view and using tool-calling to retrieve only high-resolution segments needed for a given query.
Nimrod Shabtay, M. Kimhi, Artem Spector et al.· arXiv.org· 2 citations
This work introduces MessyKitchens, a new dataset with real-world scenes featuring cluttered environments and providing high-fidelity object-level ground truth in terms of 3D object shapes, poses and accurate object contacts, and builds on the recent SAM 3D approach for single-object reconstruction and extends it with...
J. Ansari, Ran Ding, Fabio Pizzati et al.· arXiv.org· 2 citations· ⚡1
A benchmark for evaluating whether vision-language models (VLMs) can generate plant simulation configurations from imagery using in-context learning and establishing a benchmark for studying how multimodal reasoning, prompt design, and the sim-to-real domain gap affect plant phenotyping tasks is established.
Heesup Yun, I. Uyehara, Earl Ranario et al.· arXiv.org· 0 citations
This work proposes UniShield, the novel multiagent-based unified system capable of detecting and localizing image forgeries across diverse domains, including image manipulation, document manipulation, DeepFake, and AI-generated images, which innovatively integrates a perception agent with a detection agent.
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.