Interaction modality trade-offs in XR training: evidence from PC, virtual reality, and mixed reality in esports production

Abstract

Extended reality (XR), including virtual reality (VR) and mixed reality (MR), is increasingly used for training complex skills. However, the comparative effects of different interaction modalities under controlled conditions remain unclear, particularly regarding learning, task performance, and user experience. A controlled experiment compared PC, VR, and MR within a simulation‐based esports production training system. Ninety participants completed identical tasks. Outcome measures included knowledge gain, task performance, user engagement (UES‐SF), system usability (SUS), and cognitive workload (NASA‐TLX). All conditions showed significant knowledge improvement, with no significant differences across groups. VR and MR yielded higher engagement, while VR was associated with higher cognitive workload. No significant differences were found in completion scores; however, immersive conditions (VR and MR) produced significantly lower error rates than PC. PC achieved the highest usability scores. Training effectiveness depends on aligning interaction modality with instructional goals rather than immersion alone. VR was associated with lower error frequency during procedural tasks, MR offered a balanced performance–usability profile, and PC favored usability and lower workload. These findings provide practical guidance for selecting XR modalities in esports production training and support the design of context-appropriate digital training environments for workforce skill development and sustainable learning innovation.