A demonstration-based robotic feeding framework that integrates human demonstration, Dynamic Movement Primitive-based motion planning, vision-based scene perception, and robot control is presented and it is shown that the learned spoon motions can be reproduced within the detected experimental scene.
Abstract
This paper presents a demonstration-based robotic feeding framework that integrates human demonstration, Dynamic Movement Primitive-based motion planning, vision-based scene perception, and robot control. A human operator first demonstrates the scooping and feeding motions while the position and Euler-angle orientation of the spoon are recorded using a motion-capture system. The recorded trajectory is segmented into scooping and feeding motions, which are encoded using separate Dynamic Movement Primitives. Before task execution, an RGB-D camera estimates the participant's mouth position, while two AprilTags are used for robot-frame registration and tray localization. The detected tray pose is used to position the scooping motion, whereas the detected mouth position defines the positional goal of the feeding motion. The approach, scooping, and feeding trajectories are then executed sequentially by a Kinova Gen3 manipulator through a ROS~2-based framework. A real-world experiment demonstrates the feasibility of the integrated pipeline and shows that the learned spoon motions can be reproduced within the detected experimental scene.
The developed system integrates perception and locomotion control to generate smooth and stable motion commands that allow the robot to maintain a safe and consistent distance from the human target, making it suitable for applications such as personal assistance, inspection, and collaborative robotics.
Artur Babiarz, Krzysztof Jaskot, Maksymilian Grabowy· Applied Sciences· 0 citations
Robot foundation models have shown remarkable performance in robot control, yet adapting them to a new task still relies heavily on teleoperated demonstrations. Egocentric human videos offer a scalable substitute, but overlaying rendered robots on human videos or retargeting human poses into robot actions leaves signif...
Seung-Yong Lee, Suhyeok Jang, Minyoung Kim et al.· 0 citations
This study proposes an integrated machine-vision framework for robotic grasp detection and execution in complex environments. CenterNet is used to locate target objects, while a coordinated grasp-frame branch estimates feasible 2D grasp poses. Camera calibration and hand-eye calibration convert image-space predictions...
Zhong-Cong Gao· The International Conference...· 0 citations
Changing a humanoid robot's manipulation policy should not require retraining the controller that maintains the robot's balance. This study introduces DUET, a decoupled execution framework that enables locomotion and manipulation controllers to operate simultaneously by combining their commands only at the robot interf...
Kapalik Khanal, Biswash Khatiwada, S. Afrifa et al.· 0 citations
With the digitalization of industry, the need for reliable and interpretable robotic systems for object manipulation is growing. This paper examines an integrated ROS-based system that provides a complete cycle from visual object detection to its grasping and movement. The goal of the study is to develop a unified arch...
P. Rakhmetova, A. Rysbaeva, L. Kurmangaliyeva et al.· Bulletin of the National Eng...· 0 citations
In this paper, we present a mobile manipulation system for humanoid robots to solve industrial part-sorting tasks, in which the robot needs to pick up a part from one workstation and transport it to another. Several functional modules are included in the system. The lower-body control module comprises locomotion and na...
Jie Ren, Jia-Yang Wu, Long-Chang Yu et al.· IEEE Transactions on Automat...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.