Extensive experiments demonstrate that the CoDeR framework substantially extends the capabilities of existing world models, enabling long-term memory, open-ended interactions, autonomous evolution, and persistent multi-agent dynamics, while achieving state-of-the-art performance across multiple evaluation settings.
Abstract
We introduce \textbf{CoDeR}, a new paradigm for world modeling. Unlike existing video world models that implicitly represent world dynamics through visual observations, our system explicitly constructs an executable world with code and employs video generation models for visual realization. Specifically, we coordinate five complementary roles to translate high-level concepts into structured world rules, executable dynamics, and perceptual observations. This design enables \textit{long-term memory}, \textit{open-ended interactions}, \textit{autonomous world evolution}, and \textit{multi-agent scenarios}, where multiple entities can act, interact, and evolve persistently beyond the current observation. Extensive experiments demonstrate that our framework substantially extends the capabilities of existing world models, enabling long-term memory, open-ended interactions, autonomous evolution, and persistent multi-agent dynamics, while achieving state-of-the-art performance across multiple evaluation settings. Code and model weights will be made publicly available. Project Page: \href{https://becauseimbatman0.github.io/CoDeR}{CoDeR}.
MiniMax-H3 follows proxy-based spatiotemporal specifications from simple interactive worlds built by the coding agent while preserving rich visual details and dynamics, demonstrating the potential of combining code for persistent world evolution with video models for flexible visual realization.
This work proposes the Agent-Editing World Model (AEWM), which models how reasoning and actions shape future task progress rather than simulating tool responses, and combines AEWM with EditAct, which integrates these capabilities with real execution.
Oneira is presented, an interactive video world model that closes the loop between generation and interaction through an explicit, extensible world state managed by a coding agent, and enables direct and consistent interaction with newly generated objects, while preserving the effects of prior interactions over long ho...
Xin-Di Yang, Bao-Lu Li, L. Lee et al.· 4 citations· ⚡1
The Programmable World Model is introduced, a framework that decouples world-state evolution from visual observation generation and demonstrates the effectiveness of separating explicit state evolution from generative rendering for building persistent, programmable worlds.
Zheng-Hui Huang, Gui-Xu Lin, Jia-Cheng Lin et al.· 20 citations· ⚡3
World Tokens is an embodied policy architecture built around a World Adapter that bridges visual-language understanding, world-dynamics modeling, and action generation and is highly competitive on LIBERO, attains the best reported averages on SIMPLER, and substantially improves real-world R1 Pro success over a matched...
Qu Tang, Benhui Zhuang, Bo Yuan et al.· 2 citations· ⚡1
Large language model (LLM)-powered coding agents have made rapid progress in automating software engineering tasks, yet repository-level issue resolution remains challenging. Beyond generating a plausible patch, an agent must localize relevant code across interdependent files and maintain repository context that is bot...
Yun-Xiang Zhang, Hai-Quan Wang, Jia-Wei Guo et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.