Sep 2026· Italian National Conference on Sensors· 0 citations· 21 references
TL;DR
This paper proposes SEELE, a Lyapunov-guided online control algorithm that represents accumulated budget pressure with two virtual queues and converts the long-term constrained problem into lightweight per-slot decisions, and provides steady-state QoE statistically comparable to a pretrained PPO policy while significantly reducing synchronization violations and improving composition stability.
Abstract
Immersive media services increasingly rely on edge-cloud rendering to deliver interactive visual content under dynamic network, computing, and mobility conditions. Rendering an entire scene as a single service couples interaction-sensitive foreground content with context-oriented background content, making it difficult to jointly control latency, quality, synchronization, and migration overhead. This paper studies sense-driven edge-cloud foreground–background split rendering for immersive media services. We formulate an online decision problem in which foreground and background rendering layers can be independently controlled under long-term system and migration cost budgets. The formulation turns structural scene separation into a coupled layer-state control problem by preserving asymmetric QoE roles and a common composition requirement. We propose SEELE, a Lyapunov-guided online control algorithm that represents accumulated budget pressure with two virtual queues and converts the long-term constrained problem into lightweight per-slot decisions. The resulting per-slot rule balances immediate QoE loss against queue-weighted system and migration costs. Under sustained resource and network stress, SEELE provides steady-state QoE statistically comparable to a pretrained PPO policy while significantly reducing synchronization violations and improving composition stability. It also improves steady-state QoE and system debt over deterministic and QoE-prioritized baselines. A prototype implementation and controlled characterization further validate split-stream deployment, runtime observability, practical control hooks, and the latency–capacity tradeoff of layered rendering.
3D Gaussian Splatting (3DGS) enables high-quality and efficient novel-view rendering, making it a promising representation for immersive scene streaming. However, supporting interactive 3DGS viewing on lightweight clients over wireless edge networks remains challenging, as view-dependent rendering workload, video encod...
Di-Hao Hu, Jinkai Zheng, T. Luan et al.· 2026 IEEE/CIC International...· 0 citations
Mobile augmented reality (AR) supports rich interactive applications by enabling high-fidelity 3D content to be displayed in real time on mobile devices. However, under timevarying wireless conditions and fluctuating device-side rendering contention, reconstructing such high-fidelity 3D content in a timely manner remai...
Shi-Dong Wang, Bang-Cai Wei, Chun-Sheng Wang et al.· 2026 IEEE/CIC International...· 0 citations
Video re-shooting re-renders a monocular video of a dynamic scene along a user-specified camera trajectory, and the dominant recipe supplies the target geometry explicitly: per-frame depth lifts the source video into a 4D point cloud, which is rasterized along the trajectory into a point cloud render. Because the rende...
Yongbo Mao, Zijia Dai, Zhi-Shu Liu et al.· 0 citations
Current 4D generation paradigms are often bottlenecked by a sequential decoupling design: video is generated first, followed by 3D reconstruction, leading to high interaction latency. This limits applications in interactive real-time scenarios. To this end, we propose \textbf{Streaming4D}, a tightly coupled synchronous...
Xiao-Yan Liu, Jia-Xin Liu, Kang Li et al.· 0 citations
To address the issues of spatial positioning drift, unstable semantic overlay, and insufficient real-time rendering efficiency in complex dynamic scenes of immersive Japanese translation screens in augmented reality environments, which limit the development potential of related applications, this paper proposes a multi...
Li Wang· International Conference Com...· 0 citations
The growing demand for virtual reality and immersive applications has increased interest in 360° video streaming. When viewing omnidirectional content through a head-mounted display, users observe only a limited portion of the content, i.e., the viewport, at any given time. Consequently, transmitting the complete panor...
Muhammad Farooq, G. Manfredi, L. De Cicco et al.· Network· 1 citation
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 8, 2026
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.