It is argued that a Dynamic Stochastic General Equilibrium (DSGE) model is a structured world model: its state is a belief state -- the very object a latent world model learns, but supplied with causal structure and hard cross-equation constraints.
Abstract
Modern world models -- Dreamer, transformer world models (IRIS, Genie), and JEPA / next-latent architectures -- learn dynamics from observed trajectories but share a weakness: their transition map is disciplined only where data were seen, so it degrades under policy-induced distribution shift and on counterfactual states off the training path. We argue that a Dynamic Stochastic General Equilibrium (DSGE) model is a structured world model: its state is a belief state -- the very object a latent world model learns, but supplied with causal structure and hard cross-equation constraints. We introduce DSGE-Gym, a benchmark of eight DSGE environments with off-path counterfactual test sets, scaling to the ECB's 230-variable New Area-Wide Model. We find that (i)learned world models match the dynamics on-path but collapse off-path (5{\sigma} tail RMSE up to \sim 40 the on-path level), and (ii)training the same architectures on data the DSGE generates across rare and counterfactual-policy states -- coverage only a structural model can synthesize -- roughly halves tail error and cuts policy-regime error 10--280 where the counterfactual rule shifts the ergodic support. Because such coverage cannot be sampled from any single history, this measures structure's ability to manufacture the missing distribution. DSGE-Gym and all code are released as a reproducible testbed for counterfactual generalization.
DWM (Decomposed World Model), a supervision-level framework that operationalizes an explicit additive decomposition of the predicted transition into an action-invariant and a complementary action-driven component, without altering the underlying architecture or inference pipeline.
Yi-Ge Zhang, Tianqi Du, Qi Zhang et al.· 1 citation
Dynamics-effective is used to describe an intervention that changes the model's future computation in a sustained and target-specific way under autonomous rollout under autonomous rollout.
World modeling is an unsettled field: architectures, training objectives, and state representations interact in complex ways, and no single recipe dominates across environments. This makes it an ideal testbed for AI coding agents acting as autonomous researchers--a setting in which the improvement direction is not specified in advance, unlike the engineering-to-spec tasks that dominate current agent benchmarks. We introduce AutoWorldModel-Bench, a closed-loop benchmark in which frontier coding agents autonomously improve a provided base world model under a fixed compute budget. The benchmark spans eight game environments under a unified structured-state representation--ground-truth entity state extracted from each game and consumed through a shared tensor format--which isolates dynamics modeling from perception and enables minutes-per-run iteration. Across 64 sessions, Codex-5.4 and Claude Opus 4.6 improve their base on a held-out test split in all but one session, with about half (33 of 64) a substantial gain ($\Delta \geq +0.10$) and the remaining improvements smaller but positive; in 91% of sessions the winning edit is a substantive change to the model or training rather than a hyperparameter tweak. Our benchmark offers a setting in which frontier coding agents can be evaluated on open-ended research rather than engineering-to-spec problems.
Marjan Moodi, Xuan Zhu, F. Silva et al.· 0 citations
dOPSD derives the teacher's privilege directly from the student's own denoising trajectory, evaluating masked positions using later, more-decoded steps of that same trajectory rather than an external label, so the teacher's advantage emerges from the model's own decoding process.
Contrastive inverse dynamics thus provides a distribution-free anti-collapse signal that requires no target network, stop-gradient, pretrained encoder, or reconstruction objective, and it is argued that the anti-collapse pressure can instead come from the transition data itself.
The RLxF programme argues that learning signals should come from world feedback rather than from internal model proxies. We instantiate this position in safe model-based control and distil it into three concrete design principles. Empirically, across four world-model architectures spanning a 2x MSE range, MPC planning is statistically equivalent (TOST, n=200), and dynamics-based uncertainty penalties increase collision rates from 26% to 34%: the standard MBRL safety proxy is anti-correlated with safety in this regime. Replacing the model-internal proxy with three world-feedback signals (a sensor-derived margin via minimum lidar, a temporal signal via time-to-collision, and an outcome-supervised feedback model g_psi trained on prior collision labels, structurally analogous to outcome-trained reward models in RLHF) reduces collisions to 1-14% without retraining the world model or the planner. The mechanism is structural: model uncertainty has support over state-prediction space, whereas task risk has support over constraint boundaries, with empirical correlation r<0.15. From this we extract three RLxF principles (ground risk in world outcomes, validate proxies before deployment, and substitute outcome-trained feedback models when direct world signals are unavailable) and argue they apply equally to model-based control and to verifier-based or RLHF approaches in LLM alignment.