Skip to content
Preprint

Multimodal Interaction Estimation for Contact-Aware Adaptive Impedance Control

Oct 2026 · 0 citations · 45 references
Computer Science

TL;DR

A task-agnostic interaction estimation and adaptive control framework that addresses this challenge by fusing force history and 3D point cloud through a transformer-based classifier is proposed, enabling safe and precise deployment.

Abstract

With advancements in learning-based policies, robots are increasingly being deployed in human-centric environments, such as manufacturing floors and homes, where safe and precise operation requires compensating for unknown loads while remaining compliant during human interactions. Reliably distinguishing between these interaction types is challenging with a single sensing modality, as force signals cannot separate payloads from human pushes, and vision is susceptible to occlusions. We propose a task-agnostic interaction estimation and adaptive control framework that addresses this challenge by fusing force history and 3D point cloud through a transformer-based classifier. Trained with modality dropout for occlusion resilience and fine-tuned from simulation to hardware, the classifier achieves 91.89% accuracy and maintains above 90% under complete occlusion of one modality. The classifier drives a system identification framework that selectively compensates for unknown payloads and a variable-impedance controller that switches between adaptive and reactive modes, while simultaneously estimating interaction forces for downstream tasks, such as human intent estimation. We validate the framework under external perturbations and unknown loads across single-arm manipulation, deployment with an imitation-learning-based policy, intent-driven target switching, and zero-shot bimanual deployment on two Franka arms lifting a box of unknown mass, demonstrating generalization to closed kinematic chains and unseen setups, enabling safe and precise deployment.

View source

Similar papers

Preprint Sep 2026

Compliance for Free: Learning Identifiable Impedance via Bilateral Teleoperation

Vision-language-action models tell a robot where to move, but not how hard to push. Contact-rich tasks depend on that second quantity, compliance, yet no widely used demonstration interface records it. The obstacle is identifiability as realized pose and measured force cannot separate the operator's intended equilibriu...

H. Guda, Adrià Colomé, Carme Torras · 0 citations
Preprint Sep 2026

Impedance Cloning: Learning Equilibrium Point Parameters for Contact-Rich Manipulation

Contact-rich manipulation requires robots to regulate force against surfaces whose geometry deviates unpredictably from training conditions. Trajectory-based imitation learning, which reproduces observable outputs, breaks down under such shifts. We propose Impedance Cloning, which instead imitates the biomechanical pri...

Hayato Takahashi, Ryoga Oishi, Yukio Kasuga et al. · 0 citations
Open access Dec 2026

Lightweight Data-Driven Admittance Control for Massage Robots via Offline Temporal Difference Learning

Safe and effective physical human-robot interaction (pHRI) is crucial for massage robots operating in unstructured environments. Traditional fixed-parameter admittance control struggles to adapt to heterogeneous human soft tissues, while online parameter identification methods can be affected by computational latency a...

Xu-Yang Li, Jun Zhong, Hao-Min Wu · 0 citations
Preprint Oct 2026

Residual Compliant Policy: Learning Compliant Policies from Few Demonstrations

Laplacian editing is combined with simulation-based trajectory optimization to generalize across object poses, and a residual reinforcement learning policy refines the interaction forces by adjusting the reference pose of the underlying admittance controller.

Chun-Yu Jiang, Yi-Chen Cai, Shuai Li et al. · 0 citations
Preprint Sep 2026

Imp-ACT: Adaptive Impedance Control and Action Chunking with Transformers to Learn Contact-Rich Manipulation from Demonstrations

Imp-ACT is presented, a methodologically grounded and practical approach to incorporating direction-dependent Cartesian stiffness modulation directly into demonstration collection, without manual stiffness selection or offline target reconstruction.

Luca Zanetti, Doganay Sirintuna, Idil Ozdamar et al. · 0 citations
Preprint Oct 2026

Whole-Body Motion Guided Reference Generation for Uncertainty-Aware Compliant Assistance

Exoskeletons have shown great potential for augmenting human physical capabilities, yet generating reliable assistance remains challenging because human motion patterns and interaction requirements vary substantially in practice. To address this problem, a dual-loop assistance strategy is proposed to couple multimodal...

Mu-Yuan Ma, Long Cheng, Li-Jun Han et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.