Skip to content
Open access

Grasp Pose Estimation of Articulated Objects Based on Semantic and Geometric Feature Fusion

2026 · IEEE Access · Vol 14, pp. 126616-126626 · 0 citations · 35 references

TL;DR

A deep learning-based grasp estimation model designed to enable robotic manipulation with articulated objects that incorporates the attention-based semantic and geometric feature fusion (ASGF) module improved the grasp success rate in the evaluated setting.

Abstract

Unlike rigid object grasping, manipulating articulated objects requires grasp poses that ensure both stability and actionability, that is, the ability to interact with an object’s joints. Therefore, we propose a deep learning-based grasp estimation model designed to enable robotic manipulation with articulated objects. The model first utilizes RGB-D images to predict graspable regions in the form of semantic heatmaps, identifying where to grasp. These regions are then combined with geometric features derived from point clouds through an attention-based semantic and geometric feature fusion module, ultimately to regress a manipulable 6-DoF grasp pose. To train and evaluate the proposed model, we constructed a custom dataset composed of RGB-D images and 6-DoF grasp labels collected from real-world articulated objects such as doors. Real-world robotic experiments demonstrated the effectiveness of the proposed model in producing stable and actionable grasps for articulated-object manipulation. Furthermore, ablation studies showed that incorporating the attention-based semantic and geometric feature fusion (ASGF) module improved the grasp success rate in the evaluated setting.

Read PDF

Similar papers

#artificial intelligence Preprint Aug 2026

Iterative Grasp Pose Refinement: A Deep Reinforcement Learning Approach for 2D Vision

A reinforcement learning-based framework for robotic grasp refinement, integrating keypoint-based object representations with a Deep Q-Network (DQN), is proposed, offering a scalable and adaptable solution for contact-rich manipulation tasks.

Amir Arsalan Nematollahi, Shayan Ahmadi, M. T. Masouleh et al. · 0 citations
Conference Open access Jul 2026

Monocular Vision Based Control Framework for Grasping

A unified monocular vision-based grasping framework that targets both soft and rigid objects within a single control pipeline, using only RGB input and a position-controlled gripper, and is validated in real-world pick-and-place experiments.

Shail V Jadav, Dongheui Lee · 0 citations
Open access 2026

Automated Model Selection for Task-Specific RGB–Tactile Fusion in In-Hand Grasp Pose Estimation

This study investigates in-hand pose estimation of a USB stick that is already held within a robotic gripper and provides a controlled task-specific analysis showing that structured model selection can improve multimodal grasp-pose regression within the evaluated setup.

A. Altenbuchner, Bsher Karbouj, Fabian Dilly et al. · 0 citations
Open access 2026

Object-Motion-Aware Grasp Pose Refinement for Stable and Collision-Free Real-Robot Grasping

Neural-network-based grasp detection has achieved remarkable success in robotic manipulation due to its efficiency and generalization ability. However, detected poses are often not optimized, leading to undesired object motion or collisions during physical execution. This paper proposes a motion-aware refinement framework that minimizes estimated object motion while enforcing collision avoidance. The seven-dimensional pose is decomposed into approach direction, engagement depth, planar projection, and gripper opening width, enabling efficient and interpretable optimization in lower-dimensional subspaces. To evaluate grasp stability beyond conventional success metrics, we introduce the observed success rate (OSR) together with quantitative motion measurements including translation, rotation, and tilt. Real-robot experiments show that, for high-profile objects, the full pipeline improves the measured success rate (MSR) from 93.33% to 100% and OSR from 83.33% to 97.78%. It also reduces the mean translation from <inline-formula> <tex-math notation="LaTeX">$6.099{\,}mm$ </tex-math></inline-formula> to <inline-formula> <tex-math notation="LaTeX">$2.684{\,}mm$ </tex-math></inline-formula>, rotation from 3.732° to 1.344°, and tilt from <inline-formula> <tex-math notation="LaTeX">$4.417{\,}mm$ </tex-math></inline-formula> to <inline-formula> <tex-math notation="LaTeX">$1.313{\,}mm$ </tex-math></inline-formula>, while requiring <inline-formula> <tex-math notation="LaTeX">$0.82\pm 0.42{\,}s$ </tex-math></inline-formula> on average. For low-profile objects that cannot be detected by the baseline point-cloud-based planner, the full pipeline achieves 100% MSR and OSR.

Tian Tan, Redwan Alqasemi, R. Dubey · 0 citations
Preprint Jul 2026

GraspGraphNet: Graph-Structured Multi-Embodiment Dexterous Grasp Generation

GraspGraphNet is introduced, a topology-aware grasp generation framework that represents each hand as a URDF-derived kinematic graph and directly generates executable palm poses and joint configurations and suggests that graph-structured hand representations can effectively support dexterous grasp generation across robot hands with different kinematic structures.

Y. Lee, Taeyeop Lee, Hyosup Shin et al. · 0 citations
Open access Jul 2026

A Robust Visual Grasping Method for Robots in Cluttered and Stacked Scenes

An iterative closed-loop optimization framework that deeply couples SAM with FoundationPose and designs a multi-dimensional confidence assessment module that integrates both the 2D image domain and the 3D geometric domain to comprehensively evaluate the reliability of the current pose.

Zhiqiang Gao, Mengqi Li, Huihui Bai et al. · 0 citations