Experiments show that SufficientPlan substantially reduces search budgets and planning latency while maintaining competitive control performance, and caches observation and goal representations across search iterations while preserving candidate-dependent planning and selected actions.
Chang-Bai Li, Si-Rui Li, Yi-Chen Yang et al.· 0 citations
Teleoperation serves as the fallback solution to autonomous driving but reliable functions of the teleoperation require a certain amount of mobile network resources, which cannot be guaranteed at all times. Therefore, predictive quality of service (pQoS) is introduced as a concept to increase the resilience of the tele...
Xiyan Su, Jianning Gao, Mahmoud Ashri et al.· 0 citations
Portable mobile-manipulation demonstrations can help alleviate data scarcity for embodied intelligence, but obtaining reliable, low-cost, and robot-free motion supervision from RGB observations remains challenging. Existing approaches often rely on teleoperation or specialized devices equipped with additional sensing h...
Yutian Zhang, Xingrui Xiong, Siyuan Ma et al.· 0 citations
Visual disruptions can arise while a robot is executing a task, leaving a vision-language-action (VLA) policy to respond without knowing the disruption type or timing. We introduce Self-supervised Adaptation from Leftover Trajectories (SALT), which uses the leftover trajectory, the unexecuted part of the previous actio...
Ahin Lee, Jinwoo Seo, Youngsoo Jang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Across multiple dexterous hands, EigenDEXplore consistently outperforms joint-space and learned action-space baselines in grasping, in-hand reorientation, and contact-rich manipulation, and are largest in settings with less reward shaping and curriculum design.
Harsh Gupta, T. Lum, Chang-Hao Wang et al.· 0 citations
The ability to interact with articulated objects is essential for embodied intelligent systems, but collecting large-scale real-world demonstrations for these interactions remains challenging due to the precise contact and constraint-following motions involved. Although simulation provides a promising alternative, exis...
Jicong Ao, Shuhan Jiang, Yuling Zhong et al.· 0 citations
Dense 3D mapping with semantic understanding is essential for robotic perception in complex environments. Recent 3D Gaussian Splatting-based mapping approaches enable high-fidelity geometry and efficient open-vocabulary perception, but typically represent semantics as unstructured feature fields that limit object-centr...
B. Nguyen, K. Nguyen, Clinton Fookes et al.· 0 citations
An electromagnetic (EM) digital twin gives mobile robots wireless situational awareness but depends on material conductivities that change with the environment. Online calibration faces initialization sensitivity and measurement travel costs. We demonstrate a vision-language model (VLM)-guided framework using a Unitree...
Ze-Rui Kang, Yi-Shen Lim, Zhou-You Gu et al.· 0 citations
Self-improving policies continually expose new failure patterns, changing what their judges must be able to verify. However, current fixed judges constrain both optimization feedback and the discovery of useful training examples, limiting further self-improvement. This challenge is even more acute in embodied reasoning...
Ze-Wei Zhou, Rachel Luo, Yu-Long Cao et al.· 2 citations
This work performs a simulation-to-real domain shift of a VLN approach that operates in continuous environments without requiring navigation graphs or panoramic views, and integrates vision-language models that align visual inputs and linguistic instructions within a shared embedding space, facilitating natural languag...
Chalindu Abeywansa, S. Gunasekara, Devindi De Silva et al.· 2026 12th International Conf...· 0 citations
Despite its promise for scaling robot learning, egocentric manipulation data is still scarce today. Collection at scale requires vertically integrating ergonomic hardware with centimeter-precise 3D algorithms, at a precision that has not been publicly demonstrated. To address this gap, we introduce RoboCap, a 250\,g si...
Qasim Ali, Nikash Bhardwaj, Kheri Hughes et al.· 0 citations
Large language models (LLMs) let users direct heterogeneous multi-robot systems (MRS) through natural language, but make task interpretation, robot assignment, and coordination difficult to inspect and change. Based on a formative study with 12 non-expert users, we developed MRPilot, a mixed reality system organized ar...
Xiao-Ran Yang, Xun Qian, Yang Zhan et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.