NavMCP is introduced, an agentic scaffolding framework that couples a VLM reasoning agent with an NFM executor for long-horizon exploration that achieves state-of-the-art results on HM-EQA, MT-HM3D, and EXPRESS-Bench.
Zi-Xing Lei, Geng-Ze Zhou, Xiong-Hui Chen et al.· 0 citations
Experimental results show that the framework successfully interprets both direct commands and contextual requests, generates meaningful natural-language feedback, and navigates towards the desired target.
Jose Martínez-Fajardo, Pablo Pueyo, F. Caballero et al.· arXiv.org· 0 citations
Experiments on RoboTwin2.0 show that confidence-guided selection improves post-training efficiency, while dense frame and patch weighting further enhances prediction quality and embodied trajectory consistency compared with scalar reward, progress, and judge-based scoring baselines.
A central goal in robot learning is to move beyond task-specific human data collection toward robots that improve through autonomous interaction. Yet fully autonomous learning remains difficult with current policies: sparse rewards and weak zero-shot exploration make it unlikely that a robot will discover successful be...
Shreyas Kowshik, Sreyas Venkataraman, L. Wang et al.· 1 citation
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work presents VIA (Visual Interface Agent for robot control), a framework that recasts robot control as an agentic task: an off-the-shelf FM-powered agent drives a manipulator through a browser-based 3D interface by taking screenshots, issuing intuitive commands, observing the outcome, and adjusting.
Vision-Language-Action (VLA) models have achieved impressive performance on diverse embodied tasks. However, deploying VLA models on low-power onboard devices, such as the Jetson Orin, remains challenging due to their high computational complexity, which leads to substantial inference latency and low control frequency....
Zebin Yang, Qi Wang, Yun-He Wang et al.· 1 citation
This paper proposes a self-supervised method that generates online interaction rollouts from the zero-shot VLA as additional training data for finetuning and demonstrates the success of this approach across test sets probing generalization on a real ALOHA robot and a new simulation benchmark in RoboTwin.
Prachi Garg, Steve Xing, Prahit Yaugand et al.· 0 citations
Graph-as-Policy (GaP) is introduced, a multi-agent coding harness that generates directed computation graphs with perception, planning, and control nodes from a Modular Open Robot Skill Library (MORSL), and can achieve success rates that significantly outperform baselines.
Kai-Peng Chen, Shuang-Yu Xie, Letian Fu et al.· arXiv.org· 2 citations
This work proposes Online Residual Policy Adaptation (ORPA), a framework that enables immediate, feedback-driven correction of robot actions without modifying the underlying policy parameters.
Muhammad A. Muttaqien, Tomohiro Motoda, Ryo Hanai et al.· 1 citation
PACE (Persona Adaptation through Conversational Elicitation), a novel framework for the interactive generation and deployment of structured personas on the Ameca humanoid robot, introduces an Interactive Persona Elicitation Pipeline, enabling the robot to dynamically synthesize a tailored, psychologically grounded iden...
Feelium is a blimp-based telepresence platform that enables visual embodiment and touch interaction through its inflatable skin that turns the skin into a shared surface between remote and co-located partners.
George Xi Wang, Heng-Hao Li, Shan Lin et al.· 0 citations
It is found that current models often generate visually coherent videos, but struggle with constraint reasoning, counterfactual grounding, physical interaction, and unsafe-instruction suppression, and results show that visual quality and surface-level instruction following are insufficient for trustworthy robotic video...
Huiqiong Li, Jia-Yu Wang, Zhiting Mei et al.· arXiv.org· 4 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.