Unified Visual-Tactile-Action Modeling from Human Demonstrations for Dexterous Manipulation
A Unified Visual-Tactile-Action Model is proposed that maps both embodiments into aligned tactile and action representations and jointly predicts future action and tactile trajectories and achieves an average success rate of 70%, outperforming the strongest visual-tactile baseline, which achieves 29%, and an architectu...