Long-WAM is presented, a model-system framework for scaling the context of causal world-action models under real-time control constraints, and finds that access to history is not the same as using it: longer histories pay off far more when the video foundation is pretrained autoregressively (AR).
Wei Huang, Bo-Han Zhang, Chen-Zhi Liu et al.· 1 citation
Video diffusion models are increasingly developed into specialized models for diverse downstream tasks, and this development often includes a distillation stage, for example to accelerate sampling or to improve long-video generation. This stage is typically repeated for every specialized model. We introduce LongLive-Pl...
Shuai Yang, Luo-Zhou Wang, Wei Huang et al.· 0 citations
Unified Multimodal Models (UMMs) often rely on separate visual representations for understanding and generation, increasing visual context length and complicating integration with established vision-language pretraining pipelines. Recent advances in pixel-space modeling offer an encoder-free alternative, but extending...
Context-Matched Distillation (CMD) is introduced, a causal DMD framework that aligns teacher supervision with the information available when each target is generated, and naturally extends to frame-wise and chunk-wise generation, long video distillation, and camera-conditioned distillation.
Hmrishav Bandyopadhyay, Xuanchi Ren, Zijian Huang et al.· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.