A qualitative comparison of mixed reality headsets in driving simulators for human machine interaction

Abstract

This work investigates the suitability of head-mounted-display-based (HMD) mixed reality (MR) systems for dynamic driving simulators in the context of human–machine interaction (HMI) in software-defined vehicles (SDVs). The presented study examines the extent to which MR headsets can support the simulation of realistic driver behaviour during secondary tasks involving interactions with in-vehicle interfaces. An experimental study was conducted with 35 participants using a simulated urban driving scenario modelled on real traffic conditions in Berlin and compared with a real drive (RD) under comparable conditions. A within-subject design was employed to evaluate differences between MR and RD environments across several subjective and objective dimensions relevant to HMI evaluation. User comfort, cognitive workload, and behavioural validity were assessed using standardised evaluation instruments, including the simulation sickness questionnaire (SSQ) and the NASA task load index (NASA-TLX). In addition, behavioural indicators such as secondary task execution and visual attention distribution were analysed to provide a broader perspective on driver interaction within the simulated environment. The results provide insights into the strengths, limitations, and practical applicability of MR-headset-based driving simulation for HMI research. In particular, the findings highlight the potential role of MR simulators in supporting the development and early validation of advanced driver assistance systems (ADAS) and other SDV-related interface concepts.