Dual-Arm Manipulation Policy for Target-Cognitive Generalization

Abstract

Robotic manipulation policies have made significant progress in recent years, yet their target-cognitive generalization capability remains insufficient when facing unseen targets and scenarios with similar distractors. Existing methods mostly rely on implicit alignment between language descriptions and global visual features. When target appearance or geometric shape changes, or when similar distractors are present, they struggle to stably establish the correspondence between the language-specified target and action generation, thereby affecting manipulation success rates. To address this problem, this paper proposes TCG-BP (Target-Cognitive Generalization Bimanual Policy), a target-prior-driven bimanual manipulation policy. The method converts language target descriptions into temporally consistent pixel-level target masks, and enhances visual representations through image–mask collaborative encoding and fusion. In the action generation stage, the global scene representation and target-focused representation are extracted from the enhanced visual representations and injected into the policy network in a differentiated manner, enabling continuous action prediction to be constrained by scene context while being guided by target priors. On the RoboTwin 2.0 benchmark, TCG-BP improves the average success rate over π0 by 10.2, 12.2, and 13.8 percentage points under the Seen, Unseen Object, and Unseen Distractor settings, respectively. Experimental results verify the effectiveness of the proposed method.