Facet-0 unifies multimodal representation learning and reinforcement learning post-training around a joint action-wrench proposal, which reaches 82% mean success on five sub-millimeter computer-assembly tasks, compared with 15% for the strongest baseline.
Abstract
Real-world robotic assembly at sub-millimeter tolerances demands spatial precision, compliant interaction, and robustness to contact failures. We present Facet-0, a robotic foundation model that predicts and values the contact consequences of its actions. Facet-0 unifies multimodal representation learning and reinforcement learning (RL) post-training around a joint action-wrench proposal: a causal wrench history is aligned with vision-language semantics and kinematic state, and flow matching generates each action chunk together with the future wrist-wrench profile it is expected to induce. Deployment rollouts train a distributional Action-Wrench Critic to distinguish motions with similar task progress but different contact outcomes, while phase-aware rewards and contact-selective credit concentrate policy improvement on decisive interactions. To accommodate part-specific dynamics, a lightweight bounded actor reuses the frozen representation for on-robot adaptation; RL remains defined over executable Cartesian actions, while an auxiliary wrench head preserves predictive, non-commanded action-contact coupling. Trained on ManuFacet-1K, a 1,000-hour force-synchronized corpus spanning three embodiments and multiple manufacturing cells, the bounded task-adapted system reaches 82% mean success on five sub-millimeter computer-assembly tasks, compared with 15% for the strongest baseline, with 0.5 mm placement accuracy and 50 ms command latency.
Soft and continuum robots enable manipulation through distributed body deformation and contact, yet translating language and visual context into executable whole-body actuation remains a fundamental challenge. We present SWIM, a framework that maps an initial RGB observation and a language instruction to a complete act...
Ting-Cong Liu, A. P. P. Aung, Jun-Jie Xiong et al.· arXiv.org· 0 citations
Dexterous robot hands can receive useful motion intent from teleoperation or learned policies, but successful execution also depends on contact decisions that these commands rarely specify. We introduce DexFLEX, a contact-aware foundation controller that turns upstream fingertip-motion drafts into contact-consistent jo...
Wei-Kang Wan, Ze-Yu Lai, Jian-Yu Hou et al.· 0 citations
While contact-rich manipulation requires deliberate regulation of interaction forces, recent approaches to robot manipulation learning predominantly represent actions as target positions or poses. Even methods that incorporate force sensing either use it solely as an observation or, when predicting forces as part of th...
Johannes Hechtl, Yannik Blei, Simon Ball et al.· 0 citations
WACL is proposed, a hierarchical framework that describes each whole-arm contact task with three robot-agnostic representations and hands them to a quasi-static surface-contact optimizer: semantic keypoints that summarize the scene, a reference contact trajectory that specifies where and how the arm presses on the obje...
Bo-Hao Huang, Daniel Seita, Erdem Biyik· 0 citations
A three-stage pipeline that converts human motion-capture recordings into dexterous robot policies with no real-robot training data is built, which transfers one human dataset to four morphologically distinct robot hands, and executes four contact-rich bimanual tasks on physical hardware with zero real-robot training d...
In contact-rich manipulation, actions that appear equally plausible from vision can produce different contact outcomes, while reactive control based on current tactile feedback may respond too late to prevent failure. We present ForeTac, a predictive contact-guidance framework organized as a represent-predict-evaluate-...
Zhi-Yuan Chen, Shuai Chen, Hao-Ran Zhou et al.· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduNov 9, 2026