Urban navigation requires embodied agents to pursue long-horizon goals through local decisions based on egocentric observations. However, existing agentic navigation methods often struggle to translate distant goals into coherent local decisions in large-scale physical environments. Their reliance on linguistic reasoni...
Jing Xie, Shou-Wei Ruan, Yu-Bin Wang et al.· 0 citations
Force-aware manipulation typically relies on specialized force or tactile sensors. We show that force-aware manipulation can instead be achieved through visual force prediction from the deformation of a compliant Fin Ray gripper. Our approach trains two models. First, we train a visual force estimator on calibration da...
Haonan Chen, Feiyang Wu, Yuxiang Ma et al.· 0 citations
Building interactive simulators from real-world observations is a promising way to scale embodied data, but current pipelines still rely heavily on manual environment construction and calibration. We study whether frontier foundation models and coding agents can automate this process end to end. We formulate \emph{auto...
Jin-Zhou Tang, Z. Zhang, Jing Yang et al.· 0 citations
CrashSim is presented, a human behavior-informed crash scenario generation framework that uses real-world crash priors to guide generative multi-agent traffic simulation for more reliable AV safety evaluation and uses nuCrash dataset, containing over 4,000 crash and near-crash scenarios.
Ming-Xing Peng, Xu-Sen Guo, Long Chen et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Designing effective reward functions in RL typically requires substantial expertise and trial and error. Recent work automates this process with LLM-based systems that generate and iteratively improve reward code using policy feedback. However, these methods are often hard to compare because they differ in implementati...
L. M. Bhamidipaty, Lauren Robson, Linda Petrini et al.· 0 citations
For ground robots operating in outdoor environments, understanding the properties of the underlying terrain is essential for ensuring reliable operation. In most perception-based studies, this problem is formulated as categorical classification with a fixed number of classes defined during training. We propose an appro...
Skeletal motion is stored as every joint's transform at every frame, yet most of it is implied by the body rather than by what the motion is about. Compression is one way to ask what a motion must still say once the body is known, and a production codec must answer it for any skeleton with a stated error bound. Our ear...
Mingyi Shi, Huancheng Lin, Xuelin Chen et al.· 0 citations
Recent advances in robot learning have enabled generalist control policies capable of completing a wide range of tasks. However, their performance degrades when deployed in unseen environments, making it critical to detect failures and teach recovery behaviors. Existing runtime monitoring methods often require task- an...
Foundation models and large-scale human data provide rich sources of manipulation intent, but translating this intent into multi-fingered robot behavior remains difficult. Dexterous hands still lack a reusable low-level primitive that reliably establishes contact across tasks and embodiments. We propose GOTT, a reach-a...
Yu-Lin Liu, Lai Wei, Yen-Jen Wang et al.· 0 citations
WAMJET is an agentic harness that accelerates WAM inference by equipping coding agents with reusable optimization guidance and measurement and validation tools, and iteratively refines the acceleration stack as bottlenecks shift, while preserving action quality.
Le Chen, Li-Xin Liu, Jan Schneider et al.· 0 citations
This work develops a selective finite-candidate approximation and establishes conditions for recovering the best retained viable candidate in a frozen vision-language-action policy, grounded in an exact policy-relative target yet requiring neither policy retraining nor online rollouts.
Tu Nguyen, Matthieu Zimmer, Vu Anh Vu et al.· 0 citations
Vision-language-action (VLA) policies commonly learn action chunks through a fixed left-to-right (LTR) factorization, although the same expert trajectory distribution admits many valid chain-rule factorizations. We identify factorization order as an overlooked regularization choice and introduce causally anchored permu...
Yan-Qiao Chen, Yu-Han Rui, Dong-Sheng Hou et al.· 0 citations
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.