Speech-Rewarded Style Planning (SRSP), which trains a text-based style planner through a frozen downstream TTS model, achieves higher speech-style and emotion similarity to target speech and lower mel-cepstral distortion than the Base LLM and target-audio-informed captioning baselines.
Shi-Yue Zhu, Lian-Bo Liu, Sizhen Lyu et al.· 0 citations
Context length analysis indicates that benefits peak at a context length of 8, suggesting that cached probability retrieval is an effective and lightweight ASR adaptation method, in contrast to the heavy training required for Generative Error Correction (GER) or knowledge distillation (KD).
This work proposes CLAP stacking, a lightweight method that combines multiple CLAP embedding spaces that improves SRCC from 0.5521 for the best single MS-CLAP pipeline to 0.5934 and reduces MSE from 3.2500 to 2.9418.
Synthetic conversational speech has become an important resource for developing and evaluating conversational speech systems. However, existing dialogue synthesis pipelines typically generate dialogue content first and then insert interruptions, overlap, and backchannels using handcrafted markers or timing rules, makin...
Pengcheng Wang, Sheng Li, Ji-Yi Li et al.· 0 citations
D DuplexGen is presented, a dialogue synthesis framework that explicitly decouples content, timing, and acoustics and produces conversational dynamics closer to the real-dialogue reference distribution than the stitching baselines evaluated in this study.
Pengcheng Wang, Sheng Li, JiyiLi et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.