Gen2Dex: Learning Dexterous Manipulation from Simulation-Initialized Generated Video Demonstrations
This work presents an end-to-end framework for converting simulation-grounded videos into physically executable dexterous robot demonstrations and demonstrates diverse rigid and articulated manipulation tasks in simulation and successful open-loop transfer of the optimized trajectories to a real dexterous robot.