Continuous latent representations underlie recent diffusion-based lyrics-to-song and text-to-music systems, yet aligning lyric conditions with these latents remains difficult: existing systems resort to generator-side machinery such as sentence-level timestamps, auxiliary alignment objectives, or semi-autoregressive de...
Guo-Bin Ma, Yue-Peng Jiang, Da-Ke Guo et al.· 0 citations
This work introduces HiRAE (Hierarchical Representation Autoencoder), which learns a hierarchical fusion framework over the full encoder hierarchy to improve reconstruction fidelity while maintaining compatibility with generative modeling.
Xuan-Yu Zhu, Yan Bai, Yang Shi et al.· 0 citations
AgentHOI is proposed, a text-driven HOI video generation following a thinking-before-generation framework that bridges the gap between high-level textual intent and physical execution through multi-agent reasoning over perception, interaction, and motion planning.
Ziyao Huang, Shunkai Li, Juan Cao et al.· arXiv.org· 1 citation
A Aura, a unified framework for high-fidelity and identity-consistent video generation, and introduces AI director-level captions that provide dense and structured descriptions of video content to better capture scene dynamics and subject interactions.
Zixiang Zhou, Zhentao Yu, Yifeng Ma et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
