QLIMB: End-to-End Whole-Body Control for Quadruped Loco-Manipulation and Balance on Complex Terrains
Abstract
Equipping quadruped robots with manipulators significantly expands their operational workspace. However, for small-scale systems constrained by limited joint torques, achieving robust whole-body control on unstructured terrains remains a substantial challenge. Existing learning-based methods often face an inherent trade-off between locomotion stability and manipulation dexterity: traversing terrains introduces continuous base perturbations that constantly disturb state observations, significantly disrupting precise manipulation learning, whereas training exclusively on flat ground fails to yield robust locomotion skills for unstructured environments. To address these challenges, we propose QLIMB, a novel end-to-end whole-body control framework tailored for small-scale quadruped manipulators. We introduce a latent belief mixing mechanism that adaptively fuses mode-specific state representations to decouple state estimation for agile locomotion and stable manipulation within a unified policy, enabling seamless transitions between mobility and interaction modes. Furthermore, the policy exhibits emergent leg-arm coordination, ensuring smooth postural adaptations and intrinsic self-balancing during manipulation. Extensive real-world experiments demonstrate that QLIMB enables small-scale quadruped manipulators to achieve robust locomotion and stable manipulation on challenging terrains.