ReForce is presented, a Force-aware Retargeting method that turns human motion and forces into robot actions that reproduce the intended contact and supports both online force-aware teleoperation and offline data translation.
Abstract
Human demonstrations offer a scalable data source for dexterous manipulation, but transferring them to robot actions remains challenging due to the embodiment gap. Today's retargeting is mostly kinematic, yet manipulation is decided by force, which governs how the hand interacts with the object and how the object moves. In this paper, we present ReForce, a Force-aware Retargeting method that turns human motion and forces into robot actions that reproduce the intended contact. ReForce predicts a residual on the kinematically retargeted action to reach the desired force, using a general force tracker trained on large-scale simulation interactions. It supports both online force-aware teleoperation and offline data translation. In simulation and on real hardware, ReForce achieves lower force-tracking error and stronger multi-finger contact engagement on contact-rich tasks such as paper-cup grasping and tongs manipulation.
Transferring human demonstrations to dexterous robots remains challenging because differences in hand morphology and contact dynamics often cause retargeted motions to fail at producing the intended object behavior. We present \textbf{FoLD}, a framework for learning dexterous manipulation of articulated objects through...
Hao-Wei Shen, Ti-Ngai Li, Yu-Meng Liu et al.· 0 citations
Learning from demonstration (LfD) has enabled humanoid robots to acquire diverse whole-body skills, but extending this paradigm to human-object interaction (HOI) is limited by the availability of robot-compatible interaction references. We present HOI-Retarget, a contact-centric retargeting method that transfers HOI on...
Jih-Wan Shin, Adrià López Escoriza, Jun-Zhe He et al.· 0 citations
Glove-based motion capture is emerging as a scalable approach to collecting dexterous-hand demonstration data. However, due to the kinematic gap between the human and robot hand, the recorded human motions cannot be executed directly on the robot, especially for contact-rich tool-use tasks involving in-hand reorientati...
Han Yang, Yian Wang, Yun-Long Song et al.· 0 citations
Human hand-object demonstrations offer a reusable source of dexterous robot manipulation data, but transferring them across embodiments requires physically feasible retargeting. Existing physics-based approaches face limitations in retargeting success, motion-specific training efficiency, or both. To address these limi...
Kyungmin Lee, Sibeen Kim, Dongyoon Hwang et al.· 0 citations
Learning dexterous humanoid loco-manipulation from human demonstrations requires transferring not only human motion, but also the coordinated interaction structure underlying the demonstrated behavior. This is challenging because embodiment differences distort the coupling among body motion, wrist placement, finger art...
Nai-Chuan Sun, Hao Shen, Yi-Zhang Zhang et al.· 0 citations
A three-stage pipeline that converts human motion-capture recordings into dexterous robot policies with no real-robot training data is built, which transfers one human dataset to four morphologically distinct robot hands, and executes four contact-rich bimanual tasks on physical hardware with zero real-robot training d...
Zi-Hao Yang, Cheng-Yu Liu, Yu Zhou et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.