Skip to content
Book Open access

A Modular Open-Source Augmented Reality Drone Environment for Human–Drone Interaction Research

Oct 2026 · Companion Publication of the 28th International Conference on Multimodal Interaction · pp. 141-145 · 0 citations · 13 references

Abstract

This paper presents a modular open-source augmented reality (AR) environment for safe, repeatable, and extensible Human-Drone Interaction research. Developed in Unity for the Meta Quest 3, the system renders a virtual drone in the user’s physical surroundings using passthrough AR. It supports configurable three-dimensional approach trajectories, randomized trial sequences, spatial audio, experimenter-controlled stopping, safety constraints, and automatic logging of stopping distances. Experimental parameters can be adjusted through the Unity Inspector, enabling researchers to change key experimental parameters, such as drone model and trajectories, without restructuring the system. Furthermore, researchers may choose to adopt any subset of components from the system, e.g. only the drone model or audio. By reducing the risks, variability, and development effort associated with physical-drone experiments, the environment provides a reusable foundation for controlled studies in human-drone research.

Read PDF

Similar papers

Book Open access Sep 2026

ARena: Augmented Reality Simulator for Automated Vehicle-Human Road User Interaction

The advent of automated vehicles (AVs) prompted AutomotiveUI researchers to investigate how AVs can safely share the road with Human Road Users (HRUs). Researchers developed interfaces to facilitate AV-HRU interaction, e.g., on-vehicle eHMIs. However, these were mostly evaluated through online surveys with stationary p...

Ammar Al-Taie, Ming-Yu Han, Ian Oakley · 0 citations
Preprint Sep 2026

Augmented Reality Interfaces for Human-Robot Collaboration: Development of a ROS 2-Based Sensor Streaming Framework and Validation via SLAM Algorithms

A sensor streaming framework that connects the Magic Leap 2 AR headset with the ROS 2 (Robot Operating System) ecosystem is presented, laying the groundwork for safe real-time interaction and shared spatial awareness, and opening up new perspectives for the control and supervision of robotic systems in complex HRC scen...

Alessandro Rubert, S. Ghidoni, Matteo Terreran · 0 citations
#human-computer interacti... Preprint Oct 2026

XARA: A Multimodal Agentic System for eXtended Reality Experiment Generation

XARA is a novel system that integrates a dual large language model (LLM) architecture with an immersive XR environment to enable voice driven experiment generation for transportation research and discusses potential applications across behavioural travel experiments, safety studies, human factors research, and policy t...

T. Alsaleh, Thomas Zhao, Luke Guardino et al. · 0 citations

AR-Based, Gesture Guided Human Robot Interaction

An integrated framework for Human-Robot Interaction (HRI) that leverages Virtual Reality (VR) to intuitively control a robotic manipulator is presented, addressing the challenge of remote teleoperation by providing a human operator with an immersive, bird’s-eye view of the workspace.

Akshay Naik, Jay Mahajan, Samuel O. Folorunsho · 0 citations
Review Open access Oct 2026

LLM-Based Waypoint Authoring via Augmented Reality for Human–Robot Interaction

AURaPath is extended, an AR system for interactive 6-DoF waypoint determination on a UR10 collaborative robot using HoloLens2, with a voice modality for hands-free authoring, and the ability to decline out-of-scope input determines whether a model is suitable for the language-mapping tier of the safety-gated architectu...

M. Hashemi, Kasra Mojallal, Saeed Mozaffari et al. · 0 citations
Open access Oct 2026

Evaluating interaction methods in augmented reality training

As augmented reality (AR) adoption expands across training and operational domains, interaction design has served as a key determinant of user experience (UX). Although natural interaction techniques are believed to better support AR than traditional WIMP (windows, icons, menus, and pointing devices) interfaces, di...

C. L. Hughes, Waldemar Karwowski · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.