This analysis shows that world models have achieved functional substitution in interaction and controllability for specific scenarios, but remain short of traditional simulators in formal guarantees of physical laws, structured state feedback, and reproducible long-horizon evolution.
Abstract
With the rapid progress of diffusion models and large-scale video generation, generative world models are increasingly expected to replace traditional simulators, including physics engines, game engines, and reinforcement-learning environments. Yet the remaining distance from generation to simulation lacks a systematic assessment. We present a capability-based study using an external yardstick: eight capabilities of a traditional simulator, namely asset construction, physics engine, interaction, controllability, stability, state feedback, diversity, and evaluation metrics. We trace three main technical routes--latent dynamics, video generation, and joint-embedding prediction--and map exactly 200 representative works published from 2018 to June 2026 onto these capabilities. Our analysis shows that world models have achieved functional substitution in interaction and controllability for specific scenarios, but remain short of traditional simulators in formal guarantees of physical laws, structured state feedback, and reproducible long-horizon evolution. State feedback is the most neglected cross-route shortcoming: only 6 of 163 implementation papers expose a runtime interface for querying entity states or physical parameters. We identify six research directions: formalized physics, a unified action interface, first-class state feedback, long-horizon stability, downstream-utility evaluation, and cross-route hybridization. Project page: https://github.com/AtongWang/world-model-simulators
PlayWorld is introduced, a benchmark providing 171 scenarios, each with a specified objective, to assess models along four core dimensions: geometry consistency, interaction fidelity, out-of-sight evolution, and insight evolution, and basic ability metrics for video quality and controllability.
Kai Ding, Xi Chen, Ming-Hong Cai et al.· 3 citations
GAUGE, a real-world-grounded diagnostic benchmark for jointly evaluating how numerical simulators and generative video world models reproduce or deviate from real-world physics, is introduced and no uniformly faithful physics engine is revealed.
Shuai Wang, Yaxin Feng, Xuekun Jiang et al.· 2 citations
Modern driving action models are increasingly improved in a self-improvement loop, where a learned world simulator imagines future observations and the resulting data is fed back to refine the action model. However, the bottleneck of this loop lies in the simulators'inability to generate behaviorally plausible response...
Jiaqi Wang, Zhuo Zhang, Hai-Ning Guan et al.· 0 citations
This work formalizes probabilistic alignment as a distributional criterion for world models and introduces PAWBench, a benchmark for evaluating video generators as stochastic samplers of world dynamics, and introduces PAWEval, an outcome-level protocol that converts repeated video rollouts into empirical distributions...
Yuandong Pu, Le Zhuo, Sayak Paul et al.· 0 citations
WALL-SS is introduced, a world model that generates visual futures through Scale-wise autoregressive Scaling, enabling action-controllable and long-horizon robotic simulation, and consistently benefits from on-policy alignment in reducing action drift and long-horizon inconsistency.
Maeve Zhang, Rainy Sun, Xiang Wang et al.· 2 citations· ⚡1
TerraZero is a procedural driving simulator and self-play training stack that meets the goals of reinforcement learning at scale, realistic enough to ground behavior in real-world map structure, and diverse enough to cover the safety-critical long tail that logged data rarely contains.
Zhouchonghao Wu, Akshay Rangesh, Weixin Li et al.· arXiv.org· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.