Designing the AI-Driven Virtual Therapist in a Cross-Reality Environment

Abstract

Artificial Intelligence (AI) and digital media have shown potential in enhancing natural language processing (NLP) and conversational agents capable of simulating empathetic interaction. Cross Reality (CR) refers to applications that interconnect users across different stages of the Reality-Virtuality Continuum, integrating Augmented Reality (AR) and Virtual Reality (VR), within a unified shared environment. CR emphasizes immersive content and focuses on system-level continuity, bidirectional communication, and shared presence across devices. Many digital mental health tools lack integrated, multi-platform environments that support emotional connection across realities. Therefore, this study presents the design and prototype implementation of an AI-driven virtual therapist in a CR environment to deliver accessible, non-clinical therapeutic interventions targeted at general users seeking digital wellness support outside of clinical settings. The system is built upon three implemented features which are guided breathing with synchronized visual and auditory cues, AI affirmations powered by conversational AI and delivered via text-to-speech, and a shared CR calming environment that enables real-time symbolic communication between VR and AR users through Photon Unity Networking (PUN). This paper focuses on the designing and prototyping stage of the system. Comprehensive user evaluation is planned as future work.