Skip to content
Preprint

SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models

Sep 2026 · 12 citations · 59 references
Computer Science

TL;DR

SolarWM, a fully open foundation for building interactive video world models from data preparation through long-horizon inference, is introduced, providing a reproducible and extensible foundation for interactive world-model research.

Abstract

We introduce SolarWM, a fully open foundation for building interactive video world models from data preparation through long-horizon inference. Training across heterogeneous data sources and video backbones is challenging: datasets differ in temporal scale, camera geometry, visual quality, motion, and captioning styles, while video generators use distinct representations and architectures. Naive data mixing and model-specific implementations therefore produce inconsistent supervision and make results difficult to reproduce and compare. SolarWM addresses this coupling with a reconfigurable multi-source data engine and a backbone-native adaptation framework. The engine converts 1.43 million canonical clips from 10 datasets into a unified, frame-aligned contract covering visual observations, metric camera geometry, captions, quality metadata, selection decisions, and provenance, while decoupling source processing from mixture construction. Under shared camera-conditioning, training, and inference interfaces, we instantiate four 5B--33B models based on Wan2.2, LTX-2.5, and MiniMax-H3 while preserving their native representations and objectives. A unified three-stage recipe combines bidirectional adaptation, teacher-forced autoregressive initialization, and distribution matching distillation. The resulting causal models enable real-time interaction over rollouts ranging from minutes to hours after being trained on only 5s sequences. By releasing the resulting data, pipeline, recipes, weights, and framework, SolarWM provides a reproducible and extensible foundation for interactive world-model research.

View source

Similar papers

Preprint Sep 2026

VidaForge: Open Research Infrastructure for Video Pretraining Data Recipes

VidaForge is presented, an open research infrastructure that represents a video data recipe as an executable five-stage workflow from raw videos to training datasets, and demonstrates how VidaForge connects data-recipe choices to downstream model performance.

Yan Ma, Jia-Di Su, Zhulin Hu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory

WorldCrafter is a video world model that learns a camera-queryable implicit 3D-aware memory that enables streaming scene exploration from a single input image or text prompt and shows substantial gains in long-horizon consistency and camera-control accuracy while preserving visual quality during minute-scale exploratio...

Wang-Bo Yu, Kun-Hao Liu, Wen-Bo Hu et al. · 1 citation
Preprint Aug 2026

Sekai2: From World Exploration to Interactive World Modeling

Sekai2 is introduced, a multi-source real-world video dataset that carries the world-exploration footage of Sekai toward interactive world modeling, and Corpus-scale analyses demonstrate complete pose-and-caption coverage, broad geographic and semantic diversity, varied camera trajectories, and highly non-redundant tem...

Kang He, Wen-Shuo Peng, Zi-Hui Gao et al. · 2 citations · ⚡1
Preprint Sep 2026

Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generation

A large-scale synthetic data production pipeline built on Unreal Engine for generating action-conditioned, multi-view video, and describes the system architecture, the implementation decisions that emerged from production failures, and the limitations of using perceptual quality proxies for world-model data curation.

Hao-Yu Wang, Song-Chun Zhang, Hao-Ran Li et al. · 0 citations
Preprint Aug 2026

Exploring the Performance Frontier of Compact Unified Image Generation Models

Swift-Image achieves leading aggregate performance among evaluated open-source models with only 6B parameters and 243K GPU training hours; the compressed 3B model incurs nearly no loss, while few-step distillation further improves aggregate editing performance with substantially fewer sampling steps.

Taihang Hu, Zhaowen Wang, Zuan Gao et al. · 2 citations · ⚡1

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.