A Generative AI-Augmented Accessible VR Information System for Library Orientation: Prototype Development and Formative Evaluation Involving Users with Visual Impairments
TL;DR
It is suggested that integrating Generative AI within an accessible VR framework is feasible for supporting library orientation, but future systems require faster processing, proactive spatial guidance, improved text recognition, and clearer feedback during AI interaction.
Abstract
Virtual reality (VR) can support orientation in complex environments, but most VR systems remain vision-dominant and may create barriers for users with visual impairments. This study developed and formatively evaluated a Generative AI-augmented accessible VR information system for library orientation. The prototype integrated a VR library environment with visual enhancement, audio guidance, contextual notifications, speech-based interaction, and multimodal Generative AI support for environmental description, sign interpretation, bookshelf label explanation, navigation guidance, and library information access. A mixed-methods formative evaluation was conducted with eight participants with diverse visual impairment conditions. The results showed preliminary feasibility for local information access and environmental interpretation, with all participants completing sign interpretation and library information tasks. However, multi-floor navigation remained the most challenging activity, and the overall SUS score of 63.4 indicated marginal usability. Qualitative findings showed that participants valued spoken explanations and visual adjustment features, but long AI processing time disrupted exploration. These findings suggest that integrating Generative AI within an accessible VR framework is feasible for supporting library orientation, but future systems require faster processing, proactive spatial guidance, improved text recognition, and clearer feedback during AI interaction.