Prior-Informed Odometry from Human-Motion Tracking (PRIMO) generates odometry supervision by having the humanoid track diverse retargeted human motions in simulation, decoupling supervision from the deployment policies and broadening the training motion distribution, and consistently lowers mean trajectory errors relative to its Unconstrained counterpart in both simulation and real-robot evaluation.
Abstract
Simulation-trained humanoid proprioceptive odometry faces two transfer challenges: training trajectories generated by specific robot control policies intended for deployment cover only a limited range of motions, while sim-to-real mismatch can make unconstrained predictions unreliable. We address both with Prior-Informed Odometry from Human-Motion Tracking (PRIMO). On the data side, we generate odometry supervision by having the humanoid track diverse retargeted human motions in simulation, decoupling supervision from the deployment policies and broadening the training motion distribution. On the model side, a Prior-Informed estimator uses physics- and symmetry-informed priors to structure velocity and rotation prediction and a coarse raw-context pathway to preserve sensor context alongside encoded features, thereby strengthening sim-to-real generalization. Under a unified real-robot protocol, PRIMO reduces mean error by 31.6%-61.7% relative to the strongest evaluated external baseline in each domain-metric comparison. Across two locomotion-policy revisions, policy specialists exhibit symmetric crossover, whereas Tracking-Locomotion training reduces mean opposite-policy simulation error by 86.8%-94.6%. On real dynamic motion, Tracking-Locomotion training reduces mean error by 69.2%-81.7% relative to training on the union of both deployment policies. Across the tested motion compositions, the Prior-Informed estimator consistently lowers mean trajectory errors relative to its Unconstrained counterpart in both simulation and real-robot evaluation. Code is available at https://github.com/Agibot-Spatial-Intelligence/PRIMO.
PASSAGE, a perception-conditioned planner--tracker framework for humanoid traversal, using virtual reality and inertial motion capture to collect 100 h of scene-aligned human motion across 1,500 cluttered scenes and tests across 50 unseen physical layouts demonstrate traversal without prebuilt maps or offboard computat...
Yuxuan Ma, Zi-Cheng Zeng, Chun-Li Peng et al.· 1 citation
HumanoidVLN, a physics-grounded simulator and benchmark for VLN across diverse humanoid embodiments, and compatibility with NaVILA, DualVLN, StreamVLN, and JanusVLN are presented.
EgoAlign, a data-construction framework that converts these demonstrations into action and state supervision compatible with a general-purpose, continuous whole-body controller, without collecting physical-robot demonstrations, is presented.
Yi-Ming Jiang, Jin Chen, Chong-Yang Xu et al.· 0 citations
An end-to-end learned proprioceptive odometry estimator for legged robots under unreliable contact conditions that directly predicts relative displacement, relative rotation, and body-frame velocity from a recent history of onboard inertial and joint measurements.
HIGenNTO is presented, a framework that synthesizes humanoid-scene interaction motion references by optimizing the initial noise of a pretrained text-conditioned motion model under sparse spatiotemporal and scene constraints, establishing a scalable path from high-level task descriptions to physically executable humano...
Lalit Jayanti, Kashu Yamazaki, Yuto Shibata et al.· 0 citations
To the knowledge, this work provides the first demonstration of real-time cross-terrain whole-body teleoperation on a humanoid robot, alongside object interaction, stable responses to missing supports, and robust recovery from falls.
Zi-Yang Cheng, Tian-Shu Tang, Jin-Xi Lan et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.