Skip to content

AR-Based, Gesture Guided Human Robot Interaction

· 0 citations · 11 references

TL;DR

An integrated framework for Human-Robot Interaction (HRI) that leverages Virtual Reality (VR) to intuitively control a robotic manipulator is presented, addressing the challenge of remote teleoperation by providing a human operator with an immersive, bird’s-eye view of the workspace.

View source

Similar papers

Open access Oct 2026

V-DART: VR-Based Dual-Arm Robot Teleoperation with Mobile Base Control and Data Recording

We present V-DART (VR-based Dual-Arm Robot Teleoperation), an extended virtual reality framework for the teleoperation of mobile dual-arm robotic systems, building upon our previous work on stationary manipulator control. The enhanced system leverages Unreal Engine 5.6.1 (UE5) for real-time visualization and interactio...

Alejandro Torrejón, Jorge A. Calderón, P. Núñez et al. · 0 citations
Preprint Nov 2026

Teleoperation System for Service Robots using Virtual Reality Headset and Pose Estimation

This paper presents a teleoperation system for service robots that integrates human pose estimation with virtual reality (VR) to enable intuitive remote control. By using the Mediapipe framework for 2D pose detection and extending it with RGB-D data from the Intel RealSense D455 camera, a comprehensive 3D human pose es...

Eduardo Fernandes, Tiago Ribeiro, A. Ribeiro et al. · 0 citations
#robotics Preprint Sep 2026

Comparative Evaluation of an XR Pen-based Control Interface for Semi-Autonomous Mobile Robot Navigation in Service Environments

This paper presents a control interface that uses a commercial XR pen to command a semi-autonomous mobile robot in Augmented Reality (AR), and shows that the XR pen significantly outperforms the other methods in task selection time with the most consistent selections, supporting XR-based control as an intuitive alterna...

Alicia Torc, Carl Tornberg, Éric Piette et al. · 0 citations
Review Open access Oct 2026

LLM-Based Waypoint Authoring via Augmented Reality for Human–Robot Interaction

AURaPath is extended, an AR system for interactive 6-DoF waypoint determination on a UR10 collaborative robot using HoloLens2, with a voice modality for hands-free authoring, and the ability to decline out-of-scope input determines whether a model is suitable for the language-mapping tier of the safety-gated architectu...

M. Hashemi, Kasra Mojallal, Saeed Mozaffari et al. · 0 citations
Conference Open access Sep 2026

Research on AI-Based Natural Interaction and Intelligent Control System for Robots

Service robots require reliable intent recognition and physically safe control. This study proposes ANICS, a closed-loop system integrating multimodal perception, LLM-based planning, and adaptive robot control.Five sensory streams — speech, RGB-D vision, gesture, environment, and haptic feedback — were fused via four-h...

Kenny Woo · 0 citations
#robotics Preprint Sep 2026

Hardware-Free Robotics Laboratories in Mixed Reality

Teaching robotics relies on screen-based simulation, showing robot motion in an abstract coordinate frame rather than at real scale in the learner's own space, while access to physical hardware is limited by cost, safety, and scheduling constraints. We present MR-Robotics LAB, a mixed-reality (MR) platform that replays...

Santiago Berrezueta-Guzman, Habiba-Loai Khalil, A. Koshelev et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.