Joint-embedding predictive architectures (JEPAs) for world modeling train an encoder so a predictor maps a current embedding and action to the next frame's embedding, always from a single rendered frame. This has a structural blind spot: a renderer without motion blur draws a scene from configuration alone, so a single...
Ting-He Zhang, Chun-Yu Liu, Y. Liu et al.· 0 citations
This work investigates impacts and dynamics of timestep weighting in ELBO-based RL, and establishes timestep weighting as an important design choice for flow-matching RL and motivates further research into methods that choose and adapt it throughout learning.
Qin-Wei Ma, Jing-Zhe Shi, Si-Min Fan et al.· 0 citations
ELBO-based reinforcement learning offers a sampler-agnostic approach to fine-tuning flow matching models with reward feedback. Timestep weighting in ELBO-based RL has large impact on performance, and it also provides a unified view (as we show in this work) to understand prediction losses heuristically chosen in prior...
Qin-Wei Ma, Jing-Zhe Shi, Si-Min Fan et al.· 0 citations
These results show that long-context memory can be organized along the layer axis, not only the token axis, and expose both the benefits of bounded retrieval and its in-window compression tax.
Han-Lin Liu, Xuan Qi, Chunyu Liu et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
