Foundation models and large-scale human data provide rich sources of manipulation intent, but translating this intent into multi-fingered robot behavior remains difficult. Dexterous hands still lack a reusable low-level primitive that reliably establishes contact across tasks and embodiments. We propose GOTT, a reach-a...
Yu-Lin Liu, Lai Wei, Yen-Jen Wang et al.· 0 citations
WAMJET is an agentic harness that accelerates WAM inference by equipping coding agents with reusable optimization guidance and measurement and validation tools, and iteratively refines the acceleration stack as bottlenecks shift, while preserving action quality.
Le Chen, Li-Xin Liu, Jan Schneider et al.· 0 citations
Discrete motion tokenizers encode motion as atomic units and are widely used for co-speech gesture generation. It remains unclear which motion properties, especially those relevant to gesture semantics, are recoverable from these codebooks. We probe a reconstruction-trained codebook using 19 co-speech gesture descripto...
Varsha Suresh, Divij Jain, Jia Liu et al.· 0 citations
Accurately quantifying the predictive uncertainty or improving model calibration plays an important role in medical image classification, in particular in melanoma diagnosis, where accurate uncertainty quantification can have significant implications for patient care. One of the methods for calibration improvement is d...
Morgan May, Simon Caton, Pierpaolo Dondio· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
F focal loss delivers a good combination of performance in terms of AUC and uncertainty calibration in terms of expected calibration error (ECE) simultaneously, and the results suggest that focal loss delivers a good combination of performance in terms of AUC and uncertainty calibration in terms of expected calibration...
Morgan May, Pierpaolo Dondio, Simon Caton· 0 citations
Vision-language models (VLMs) are increasingly trained to generate structured outputs like points and bounding boxes that downstream interfaces, agents, and robots can act on, yet safety alignment of this output channel has not been systematically analyzed. We study visual grounding safety by repurposing three safety b...
Erfan Shayegani, Kundan Krishna, Yue Dong et al.· 0 citations
Multi-agent debate (MAD) has emerged as an effective paradigm to improve the reasoning capabilities of large language models (LLMs) and is increasingly being extended to multimodal settings. However, existing multimodal MAD frameworks typically expose agents to the same fixed visual input, ignoring substantial variatio...
Khanh K. Nguyen, Van Dai Do, Tien-Thuy Nguyen et al.· 0 citations
Long-video agents can actively gather question-relevant evidence, but they typically leave a central decision implicit: when has the agent seen enough to answer? We propose CASE, a plug-in termination framework that frames this decision as policy-conditioned sequential stopping. At each causal checkpoint, CASE combines...
Yi-Ming Du, Cheng-Hao Liu, Zhiyuan Liu et al.· 0 citations
This work introduces VideoResearchAgent, a scalable training framework for open-web video research, and introduces Retrieval-Domain-Randomized GRPO (RDR-GRPO), which diversifies candidate rankings, distractors, metadata, and result structure during training to reduce overfitting to simulated retrieval.
Yu-Hang Zhou, Fei-Yu Li, Yu-Xin Wu et al.· 0 citations
Graphical consoles offer a practical interface for medical acquisition assistance, allowing agents to work through the controls and visual feedback used by human operators. Reliable assistance requires linking on-screen anatomy to acquisition decisions that determine what image evidence becomes available next. We intro...
Zi-Yang Long, Xin-Qi Li, Lu-Jing Xing et al.· 0 citations
Geodesic Unlearning (GU), a lightweight parameter-editing method that leverages Grassmannian subspace geometry for structured subspace correction to improve missing-modality robustness, is proposed and suggested as a practical route for robustness correction.
Song-Yuan Sui, Zhen Tan, Mohan Zhang et al.· 0 citations
Communication in shared space interweaves verbal and non-verbal signals, and pointing gestures anchor language to the environment:"put the cup on that one"is uninterpretable without the gesture that fixes the referent. Yet no common framework exists for evaluating whether generated gestures indicate their intended refe...
A. Deichler, Rishabh Dabral, Fethiye Irmak Doğan et al.· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.