Skip to content
Open access

An Architecture for Constructing Mulsemedia Applications Using Real-Time Fluid Simulation

Aug 2026 · ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) · Vol 22, pp. 1 - 21 · 0 citations · 61 references

TL;DR

An interactive simulation system based on Smoothed-Particle Hydrodynamics (SPH) designed to model gaseous-like sensory effects for real-time applications and provides a foundation for the design and evaluation of future mulsemedia experiences is introduced.

Abstract

The integration of sensory effects—such as wind, heat, and scent—into multimedia applications holds great promise for enhancing user immersion and Quality of Experience (QoE). However, simulating the propagation of such effects in dynamic environments presents considerable challenges, particularly in achieving real-time interactivity, physical plausibility, and perceptual coherence. This article introduces an interactive simulation system based on Smoothed-Particle Hydrodynamics (SPH), designed to model gaseous-like sensory effects for real-time applications. The proposed architecture allows authors to configure virtual environments, define sensor and actuator properties, and simulate the behavior of sensory effects under different conditions. A wind-with-temperature simulation scenario is presented as a proof of concept, demonstrating the feasibility of the approach. Experimental results indicate that the proposed model captures key physical trends observed in real-world measurements. Thus, the proposed system provides a foundation for the design and evaluation of future mulsemedia experiences.

Read PDF

Similar papers

Preprint Oct 2026

WMEval: Evaluating Interactive World Models Grounded on Physical Simulations

Interactive world models hold immense potential for high-stakes applications in robotics, game engines, and immersive digital twins, yet existing benchmarks primarily focus on perceptual similarity rather than the physical-causal coherence essential for real-world utility. We introduce WMEval, a comprehensive benchmark...

Lan-Xiang Hu, Yi-Xin Huang, Abhilash Shankarampeta et al. · 0 citations
Preprint Oct 2026

Bringing physics-based controller policies to virtual reality

Nowadays, it is easy to set up any element of a VR experience so users can interact with it physically, except for interactive VR characters. Can we extend this to animated VR characters? In this work, we studied whether physics-based character animation (PBCA) controllers can produce high-quality movement in VR-compat...

Joan Llobera, Pierre Nagorny, Balint K. Hodossy et al. · 0 citations
#edge computing Conference Sep 2026

Application of AR real-time registration and interaction technologies for immersive e-commerce live streaming in OBE practical teaching

This paper proposes an augmented reality real-time registration system for e-commerce live streaming environments and applies it to an outcome-oriented education (OBE) practical teaching framework. The system employs a vision-inertial tightly coupled state estimation, integrating local bundle adjustment and semantic ma...

Wan-Lan Xie · 0 citations
Preprint Oct 2026

DexBioLab: Benchmarking Dexterous Manipulation with Dynamic Experimental Phenomena in Realistic Laboratories

Automating biological laboratories requires robots to perform dexterous tool interactions under realistic visual conditions while handling dynamic experimental phenomena, presenting significant challenges for robotic manipulation. To enable systematic evaluation under these conditions, we introduce DexBioLab, a simulat...

Xuan Wu, Yue Shi, Yong-Can Yang et al. · 0 citations
Open access Sep 2026

Multiuser immersive cultural experiences enabled by 5G, AI and free-viewpoint video

Extended Reality (XR) enhances cultural experiences by immersing users in virtual environments where virtual assets and 3D reconstructions provide a stronger connection to real-world scenarios. In this work, we present a platform for collaborative immersive cultural experiences, focused on real-time interaction between...

Javier Usón, César Díaz, Isabel Rodríguez et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.