Learning controllable world dynamics from heterogeneous interaction videos is challenging because robot embodiments use incompatible action spaces, while human videos lack native control labels. We present RynnWorld-Latent, a cross-embodiment video world model that uses the 3D-grounded latent actions introduced by Rynn...
Hao-Yu Zhao, Yin-Zhou Tang, Zi-Xuan Wang et al.· 1 citation
RynnWorld-4D is introduced, a generative model that co-produces future RGB frames, depth maps, and optical flow from a single RGB-D image and a language instruction within one unified diffusion process, and achieves state-of-the-art performance on real-world dexterous bimanual manipulation tasks, particularly excelling...
Haoyu Zhao, Xingyue Zhao, Siteng Huang et al.· 1 citation
Digital teleoperation, a paradigm that decouples data collection from physical constraints by replacing the real robot with a generative world model, is introduced in RynnWorld-Teleop, a system that integrates depth-aware skeletal conditioning, progressive human-to-robot training on a video Diffusion Transformer, and s...
Haoyu Zhao, Xingyue Zhao, Hangyu Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.