Skip to content
Preprint

Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models

Oct 2026 · 4 citations · ⚡ 1 influential · 54 references
Computer Science

TL;DR

Oneira is presented, an interactive video world model that closes the loop between generation and interaction through an explicit, extensible world state managed by a coding agent, and enables direct and consistent interaction with newly generated objects, while preserving the effects of prior interactions over long horizons.

Abstract

Generative video world models can now synthesize open-ended environments that agents can navigate and interact with in simple ways. Yet open-ended generation does not imply full interaction: as a generated world expands, newly created content through navigation should expand what the agent can act upon, and as the agent changes the world, those changes should become persistent parts of the environment rather than transient visual effects. We characterize these two requirements as Open-World Interactivity, where newly generated or encountered entities are incorporated into the actionable world, and Persistent State, where interaction outcomes are committed to the world state and continue to influence subsequent observations and interactions. We present Oneira, an interactive video world model that closes the loop between generation and interaction through an explicit, extensible world state managed by a coding agent. Given the current observation and an action or high-level goal, the agent reads the world state, grounds the relevant entities, plans the interaction, and writes its outcome back into a world state table. When exploration reveals new objects, the agent incorporates them from generated observations, allowing the interaction space to expand with the generated world. Meanwhile, previously induced state changes are carried across video segments, making the consequences of interaction persistent parts of subsequent world evolution. The updated world state is rendered along the camera action trajectory into a coarse conditioning video, from which a video generator fills in the appearance, motion, and interaction details not represented in the state. Experiments show that Oneira enables direct and consistent interaction with newly generated objects, while preserving the effects of prior interactions over long horizons. Project page: https://madaoer.github.io/projects/oneira

View source

Similar papers

Preprint Nov 2026

AgiWorld: An Agentic Video World Model for Building Persistent Worlds

Recent interactive video world models generate visually compelling videos from a single image, following user-provided camera motion and text prompts. However, such low-level control demands substantial user effort to realize a high-level intent, and the generated world struggles to remain persistent as the exploration...

Shao-Heng Fang, Yi-Qun Mei, Hanwen Jiang et al. · 1 citation
Preprint Oct 2026

Generative World Simulation with DAO and JING

We present a Generative World Simulation framework that couples persistent shared world state with continuous first-person audiovisual generation. The framework integrates DAO, a computable world engine, and JING, an Egocentric Interactive Experience Model, to support sustained interaction for humans and agents. DAO ma...

Xgen Team Guohao Cai, Hao-Xuan Che, Frank Fan et al. · 1 citation
Preprint Oct 2026

OpenWAM: An Open Framework for Composable World-Action Models

World-action models (WAMs) couple future prediction with robot control, yet existing systems often vary the video backbone, interaction structure, supervision, and inference procedure simultaneously, making their design choices difficult to compare. We introduce OPENWAM, an open world-action modeling framework built ar...

Heng Yu, David Yuan, Ju-Ze Zhang et al. · 5 citations · ⚡1
Preprint Oct 2026

EmbodiedWorld-200K: Toward Embodied World Agents via Embodied-Planning Dataset and Interactive World Models

Building embodied agents that can perceive, reason, and act across diverse 3D worlds is a central research direction toward artificial general intelligence. Yet most existing work remains confined to specific tasks in a single scene and transfers poorly to new environments, leaving general embodied agents for open-worl...

X. Feng, J. Tang, Z. Lin et al. · 0 citations
Review Oct 2026

State World Models: Execute the Rules, Generate the Pixels

Existing world models can generate action-conditioned video from a single image. Many focus on camera movement, allowing users to explore the generated scene. However, navigation alone does not ensure that an action follows persistent rules when its outcome depends on state that is invisible in the current frame. We pr...

Yan-Ki Chan, Yanran Zhang, Wen-Zhao Zheng et al. · 2 citations · ⚡1
Preprint Oct 2026

Hy-Nomas: Towards Free-form Interactive World Generation

Hy-Nomas is a video world model with an 8B diffusion backbone that supports free-form text instructions and continuous camera control across multiple interaction turns that generates variable-length segments conditioned on current inputs and cached history.

Qiao-Ling Chen, Jia-Xiang Cheng, Xue-Qing Deng et al. · 3 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.