Skip to content

Wait for It: A Component-Level Analysis of Latency Feedback Mechanisms for LLM Agents in VR

Oct 2026 · 0 citations · 14 references
Computer Science

TL;DR

It is suggested that natural, behavior-based feedback maintains the illusion of conversing with a thinking entity, while technical indicators expose the computational substrate in AI agents.

Abstract

Delays in AI responses pose a significant challenge to immersive Virtual Reality experiences. While previous research demonstrates that feedback can reduce the perception of waiting, we lack understanding of which types work best and why. We conducted a within-subjects study with 18 participants to systematically compare three isolated feedback approaches during VR agent interactions: verbal fillers (e.g., um..., hmm...), visual indicators (loading spinners), and embodied gestures (thinking animations). Our results revealed that embodied gestures significantly outperformed visual loading indicators across multiple dimensions, making agents feel more lifelike and socially present. Interestingly, explicit visual feedback like loading spinners actually degraded perceived humanness and broke immersion by forcing users to shift from social to technical mental models. These findings suggest that natural, behavior-based feedback maintains the illusion of conversing with a thinking entity, while technical indicators expose the computational substrate. We present empirically-grounded design guidelines for creating more engaging AI-powered VR agents.

View source

Similar papers

Open access Oct 2026

Before They Ask: Anticipating Help-Seeking from Behavioral Signals in Virtual Reality

Immersive virtual reality (VR) is increasingly used for training and has the ability to track learner behavior continuously. Yet support is usually delivered only once a learner asks for it, and help is not always sought when needed. While support based on performance is common, less is known about detecting an emergin...

Sepideh Habibiabad, Jonas De Bruyne, Samuel Dossche et al. · 0 citations
#human-computer interacti... Preprint Sep 2026

Beyond Task Performance: Lessons Learned from Evaluating an Exploratory VR Interaction Technique

A within-subjects user study comparing RodCast with Go-Go Hand and FlowerCone across three representative interaction tasks revealed that the proposed implementation incurred performance costs on more demanding manipulation tasks, while qualitative feedback suggested that participants attributed these challenges to the...

Nevzat Umut Demirseren, Corey R. Pittman, I. B. Adhanom et al. · 0 citations
Open access Sep 2026

Spontaneous visual perspective-taking in human–robot interaction as a methodological artifact of spatial stimulus arrangement

It is revealed that VPT was higher when stimuli were presented exclusively in the robot’s environment, which suggests that earlier VPT research may have a critical methodological limitation, as it did not account for spatial context in real human–robot interaction scenarios, which could limit its applicability to real-...

Noushin Jamaatlou, Eva Wiese, Craig G. McDonald et al. · 0 citations
#artificial intelligence Review Sep 2026

Generative Tutorial: Towards Live Contextualized Visual Instructions for Physical Tasks

Visual instructions for physical tasks are typically authored in one context and followed in another, requiring users to translate demonstrated tools, materials, and spatial relationships into their own environment. We introduce Generative Tutorial, a conceptual framework for live visual instruction that depicts intend...

Mu-Zhe Wu, Zuo-Jun Li, Xu Wang et al. · 1 citation
Oct 2026

Semantically enhanced eye-tracking controls in human-robot interaction: a comparison study.

Operators controlling robotic systems for sequential manipulation tasks present cognitive loads that vary with how they specify intent to the robot. Limited evidence exists on how semantically mediated voice and gaze interfaces differ in operator performance, visual attention, and perceived workload. This study present...

Rui-Tong Tian, Heng-Xu You, Fang Xu et al. · 0 citations

Related blog posts

Microsoft Research Blog Nov 5, 2026

Formally verifying agent-written full-stack web apps with PDD Kit

AI agents can generate code at a scale that’s hard for humans to review line-by-line. PDD Kit helps ensure the code is doing what the developer intended by creating formal specifications and testing against them. It converts developer intent into a Verus specification, proves AI-generated code meets it for every input, and uses tests where proofs aren't practical. Developers review intent, not every line. The post Formally verifying agent-written full-stack web apps with PDD Kit appeared first o…

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

MIT News · Artificial Intelligence Oct 23, 2026

Reinforcing the value of human understanding at MIT

During the School of Humanities, Arts, and Social Sciences’ 75th Anniversary Symposium, President Sally Kornbluth said “MIT has never needed your particular insight and guidance more than we do now.”

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.