Skip to content
Review Open access

Improving User Evaluations in Multisensory Environments through Physiological Signals

Oct 2026 · Brazilian Symposium on Multimedia and the Web · 0 citations · 4 references

Abstract

Mulsemedia systems enrich audiovisual content with effects such as wind, temperature, smell, and haptics, but their evaluation still relies mainly on retrospective questionnaires. In immersive experiences, these measures can aggregate distinct moments, interrupt presence, and overlook unreported reactions. This doctoral thesis investigates how physiological signals can complement subjective UX and QoE measures. Its central contribution is a six-stage, technology-independent methodology integrating study planning, participant preparation, synchronized physiological and event-data acquisition, post-session feedback, and multimodal analysis. Informed by a systematic review, the methodology was examined through four studies involving thermal-wind video, audiovisual asynchrony in 360-degree video, olfactory augmentation, and a firefighter serious game. Results show that immersive exploration can reduce the reported salience of audiovisual offsets, congruent scent can stabilize ratings under asynchrony, and static scent delivery can lose coherence when VR users move. Physiological measurements add continuous temporal evidence but require triangulation with self-reports and system events because activation does not uniquely identify emotion. The thesis contributes a replicable evaluation methodology, findings on crossmodal coherence, and practical guidelines for more reliable multisensory systems.

Read PDF

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.