We present M5-TTS, a compact text-to-speech system supporting multilingual and Chinese multidialect synthesis, zero-shot voice cloning, speaker-specific multilingual generation, and CPU streaming. Its 50M-parameter language model, excluding the speech codec, combines a temporal backbone with a local multi-token predict...
Wen-Hao Li, Jing-Bin Hu, Sheng-Ming Ling et al.· 0 citations
Recent advances in speech generation are shifting toward context-aware, multi-turn, and multi-speaker synthesis. While these capabilities are in high demand for applications such as audiobook and audio drama production, evaluation has not kept pace with these advances. Beyond traditional zero-shot Text-to-Speech (TTS),...
Jing-Bin Hu, Zi-Tao Yang, Xiao-Ge Peng et al.· 0 citations
Recent controllable speech generation requires training data with fine-grained annotations of speaker traits, prosody, emotion, paralinguistic cues, acoustic scenes, and context. Existing workflows often rely on manual correction, paid hosted multimodal services, or fixed processing chains, which limits large-scale dat...
Qi-Rui Zhan, Shui-Yuan Wang, Jing-Bin Hu et al.· 0 citations
StreamTN is proposed, a lightweight LLM-based Chinese streaming TN model that employs a dual-track streaming framework in which input tokens and output tokens are processed on two parallel tracks, enabling low-latency real-time inference without complex prompting.
Wen-Hao Li, Jin-Rui Liang, Hao-Yu Zhang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.