Skip to content

Wonder: Video World Model Done Better

Jul 2026 · arXiv.org · Vol abs/2607.26037 · 5 citations · ⚡ 1 influential · 50 references
Computer Science

TL;DR

This work introduces a novel camera conditioning with a dense coordinate field whose renderings provide spatially aligned motion and orientation cues, allowing the model to interpret camera motion directly as visual evidence, regardless of actual context length.

Abstract

We present Wonder, a general-purpose video world model for real-time, camera-controllable world exploration. Given an image or a conditional video, Wonder constructs a playable world where users can navigate interactively by moving the camera, discovering unseen regions, and revisiting previously observed areas in real time and over a long-term horizon. Achieving this capability requires a system-level co-design of control method, memory mechanism, and training strategy. We introduce a novel camera conditioning with a dense coordinate field whose renderings provide spatially aligned motion and orientation cues, allowing the model to interpret camera motion directly as visual evidence. To support fast and precise memory retrieval over a growing generation context, we propose an efficient sparse attention-based memory mechanism, enabling the model to selectively attend to a small set of relevant context tokens at inference time, regardless of actual context length. We further develop several techniques to rectify the self-forcing-style distillation pipeline, improving the student model's ability to respect control signals, as well as maintaining diverse generation modes and long-term memory from the teacher. Together, these components enable Wonder to synthesize diverse, minute-scale videos at 16 FPS while preserving coherent geometry, appearance, and dynamics across long rollouts. Beyond image-to-video generation, Wonder naturally supports video-conditioned generation, allowing existing dynamic scenes to be re-shot in real time.

View source

Similar papers

Jul 2026

AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report

AlayaWorld is presented, an interactive long-horizon video world model that generates 24-fps video at 540p and 720p and introduces a discrete autoregressive distillation formulation that combines distribution-matching distillation, self-forcing++, and consistency distillation, reducing inference from approximately 30 s...

AlayaWorld Team Kaipeng Zhang, Chuanhao Li, Y. Zhan et al. · 4 citations
Jul 2026

VIPER: Visual In-Context Physics Reasoning for Physically Plausible Video Generation

Experiments on an unseen validation set show that VIPER achieves stronger reference-video physical similarity and higher human preference than representative video generation and video-as-prompt baselines, while maintaining competitive general video quality.

Tianxi Chen, Han-Mo Chen, Hua-Jin Chen et al. · 0 citations
Jul 2026

M4World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streaming

M$^\text{4}$World, a Multi-view and Multimodal generative driving world model that synthesizes future surround-view video streams and synchronized LiDAR scans while supporting interactive object Manipulation and stable Minute-long streaming is presented.

Ke Cheng, Hanqiao Ye, Lei Shi et al. · 1 citation
Preprint Aug 2026

VideoHarness-RSI: Recursive Harness Self-Improvement for Long-Video Understanding with Frozen Vision-Language Models

VideoHarness-RSI is introduced, a controlled framework that recursively searches executable context constructors around a frozen VLM while keeping the answering model and interface fixed and establish executable context construction as a distinct optimization layer and provide an auditable baseline for studying harness...

Guo-Yang Xu, Hao Chen · 2 citations · ⚡1
Preprint Jul 2026

ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU

This work progressively distill a bidirectional action-conditioned teacher into a causal student through teacher forcing and ODE distillation, and introduces LongForcing to align long student self-rollouts with an extended-horizon teacher, mitigating accumulated distribution shift and autoregressive drift.

Fan Jiang, Zhaoxu Sun, Mengchao Wang et al. · 6 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.