From Planning to Verification: Designing Interactions for Multi-Drone Search and Rescue Operations in Mixed Reality

Abstract

Search And Rescue (SAR) operations often occur in complex and hazardous environments under critical time constraints. While drones accelerate search and reduce risks, the use of multi-drone systems in real operations remains limited. Existing research emphasizes high automation, positioning operators as supervisors while real missions require continuous adaptation. We explore interaction design for multi-drone SAR operations, focusing on transitions between mission planning, supervision, and manual piloting. Using a research-through-design approach, we conducted interviews with SAR professionals, iteratively designed a virtual reality prototype integrating both multi-drone supervision and manual piloting; and evaluated its use with drone pilots and experts. Our findings identify interaction such as manual piloting, manual trajectory specification, and pausing and resuming drones that operators use to manage workload, maintain situational awareness, and resolve uncertainty during missions. These insights inform the design of multi-drone systems that balance efficiency with operator control and mission-critical flexibility in dynamic SAR contexts.