Recent advances in speech generation are shifting toward context-aware, multi-turn, and multi-speaker synthesis. While these capabilities are in high demand for applications such as audiobook and audio drama production, evaluation has not kept pace with these advances. Beyond traditional zero-shot Text-to-Speech (TTS),...
Jing-Bin Hu, Zi-Tao Yang, Xiao-Ge Peng et al.· 0 citations
Recent controllable speech generation requires training data with fine-grained annotations of speaker traits, prosody, emotion, paralinguistic cues, acoustic scenes, and context. Existing workflows often rely on manual correction, paid hosted multimodal services, or fixed processing chains, which limits large-scale dat...
Qi-Rui Zhan, Shui-Yuan Wang, Jing-Bin Hu et al.· 0 citations
StreamTN is proposed, a lightweight LLM-based Chinese streaming TN model that employs a dual-track streaming framework in which input tokens and output tokens are processed on two parallel tracks, enabling low-latency real-time inference without complex prompting.
Wen-Hao Li, Jin-Rui Liang, Hao-Yu Zhang et al.· 0 citations
Progress in dialectal speech technology is hindered by the scarcity of large-scale, real-world corpora. For Minnan speech, existing resources remain limited, and few provide paired Minnan and Mandarin transcripts at scale. To address these gaps, we introduce WenetSpeech-Min, an open-source corpus comprising around 10,0...
Hao-Yu Zhang, Chun-Jiang He, Hong-Tao Li et al.· 0 citations
Motion-Omni is presented, an end-to-end framework in which a spoken dialogue model natively outputs explicit facial expression together with hand, upper-body and lower-body motion, generated directly from the hidden states that produce the speech.
Chengqian Ma, Wei Tao, Hao-Yu Zhang et al.· 0 citations
SphereVAE is proposed, which constrains the VAE latent space to the unit hypersphere and regularizes the latent distribution toward a uniform prior, so that information is encoded mainly by directional variation, providing a bounded geometric target for autoregressive prediction and reducing the risk of norm drift.
Hao-Yu Zhang, Jing-Bin Hu, Han-Ke Xie et al.· 0 citations
X-Pred MeanFlow is proposed, a few-step streaming token-to-mel decoder that reparameterizes MeanFlow with mel-space prediction and introduces layer-selective block-wise attention to enable continuous chunk-wise generation with bounded context.
Han-Ke Xie, Xia-Ming Ren, Qi-Rui Zhan et al.· 0 citations
A Context-Aware Direct Preference Optimization (CA-DPO) method that significantly outperforms the baseline across all objective and subjective metrics, and establishes an evaluation method featuring a 500-sample test set and an LLM-as-Judge framework to independently assess reasoning and execution fidelity.
Jing-Bin Hu, Lu-Yu Wang, Wen-Jie Tian et al.· 0 citations
The proposed DiTAR+, a dual-optimization framework for continuous-latent Autoregressive Diffusion Transformer models, introduces Dilated Context Sampling and Hierarchical Acoustic Masking to prevent shallow layers from attending to acoustic pre-context, explicitly decoupling semantic alignment from acoustic detail reco...
Zi-Yu Zhang, Tian-Lun Zuo, Han-Zhao Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
