User-Centered Evaluation of VR Training for Hybrid Manufacturing: A Cognitive Walkthrough Approach

Abstract

Virtual reality (VR) training modules offer immersive and interactive learning experiences. They are especially useful in complex fields like hybrid manufacturing, where detailed procedural knowledge is essential. Identifying user requirements early in development is essential to create cost-effective, user-centered training modules. The cognitive walkthrough is a structured usability evaluation approach that uncovers design flaws before broader implementation. This study aims to evaluate the usability of a VR-based hybrid manufacturing training module using cognitive walkthroughs.  The study is focused on understanding user interactions and identifying potential design issues for each task involved in a metal repair process. A prototype VR training module was created in Unity for the Meta Quest app. Eight evaluators performed cognitive walkthrough sessions using this prototype. Data were also collected using task-based questions grounded in Nielsen heuristics and design principles to assess usability, identify design flaws, and observe user performance. Participants used the think-aloud method, providing real-time feedback. Early findings highlight key user requirements and usability issues in the initial stages of VR module development. After conducting this cognitive walkthrough, numerous design issues and usability problems have been identified, providing critical insights for enhancing the VR training module. These improvements will contribute to a more effective and user-friendly learning experience, ultimately supporting skill development in hybrid manufacturing and similar complex fields.