Skip to content
Preprint

From Generation to Simulation: How Far Are World Models from Being True Simulators?

Aug 2026 · 0 citations · 221 references
Computer Science

TL;DR

This analysis shows that world models have achieved functional substitution in interaction and controllability for specific scenarios, but remain short of traditional simulators in formal guarantees of physical laws, structured state feedback, and reproducible long-horizon evolution.

Abstract

With the rapid progress of diffusion models and large-scale video generation, generative world models are increasingly expected to replace traditional simulators, including physics engines, game engines, and reinforcement-learning environments. Yet the remaining distance from generation to simulation lacks a systematic assessment. We present a capability-based study using an external yardstick: eight capabilities of a traditional simulator, namely asset construction, physics engine, interaction, controllability, stability, state feedback, diversity, and evaluation metrics. We trace three main technical routes--latent dynamics, video generation, and joint-embedding prediction--and map exactly 200 representative works published from 2018 to June 2026 onto these capabilities. Our analysis shows that world models have achieved functional substitution in interaction and controllability for specific scenarios, but remain short of traditional simulators in formal guarantees of physical laws, structured state feedback, and reproducible long-horizon evolution. State feedback is the most neglected cross-route shortcoming: only 6 of 163 implementation papers expose a runtime interface for querying entity states or physical parameters. We identify six research directions: formalized physics, a unified action interface, first-class state feedback, long-horizon stability, downstream-utility evaluation, and cross-route hybridization. Project page: https://github.com/AtongWang/world-model-simulators

View source

Similar papers

Preprint Aug 2026

PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives

PlayWorld is introduced, a benchmark providing 171 scenarios, each with a specified objective, to assess models along four core dimensions: geometry consistency, interaction fidelity, out-of-sight evolution, and insight evolution, and basic ability metrics for video quality and controllability.

Kai Ding, Xi Chen, Ming-Hong Cai et al. · 3 citations
Preprint Aug 2026

BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generation

Modern driving action models are increasingly improved in a self-improvement loop, where a learned world simulator imagines future observations and the resulting data is fed back to refine the action model. However, the bottleneck of this loop lies in the simulators'inability to generate behaviorally plausible response...

Jiaqi Wang, Zhuo Zhang, Hai-Ning Guan et al. · 0 citations
#artificial intelligence Preprint Aug 2026

PAWBench: How Far Are We from Probabilistically Aligned World Modeling?

This work formalizes probabilistic alignment as a distributional criterion for world models and introduces PAWBench, a benchmark for evaluating video generators as stochastic samplers of world dynamics, and introduces PAWEval, an outcome-level protocol that converts repeated video rollouts into empirical distributions...

Yuandong Pu, Le Zhuo, Sayak Paul et al. · 0 citations
Preprint Aug 2026

WALL-SS: Scaling Long-horizon World Models via Next-Scale Autoregression

WALL-SS is introduced, a world model that generates visual futures through Scale-wise autoregressive Scaling, enabling action-controllable and long-horizon robotic simulation, and consistently benefits from on-policy alignment in reducing action drift and long-horizon inconsistency.

Maeve Zhang, Rainy Sun, Xiang Wang et al. · 2 citations · ⚡1
Jul 2026

TerraZero: Procedural Driving Simulation for Zero-Demonstration Self-Play at Scale

TerraZero is a procedural driving simulator and self-play training stack that meets the goals of reinforcement learning at scale, realistic enough to ground behavior in real-world map structure, and diverse enough to cover the safety-critical long tail that logged data rarely contains.

Zhouchonghao Wu, Akshay Rangesh, Weixin Li et al. · 2 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.