VoiceWeaver addresses the problem of adding expressive and environmental controls to a speech generator with structured label prefixes and staged emotion-tone-event training in a shared text-audio model, while embedding decorrelation and attribute dropout regularize conditioning.
Xiao-Su Su, Yun Cao, Yi-Ping Ni et al.· 0 citations
Realtime spoken interaction demands deep reasoning, prompt responses, and fluid turn-taking. We present StepAudio 3 Realtime, an audio-language foundation model organized around a continuous listen-converse-think-act loop. Deep Perception captures rich acoustic cues to interpret user intent, while Seamless Duplex model...
Bin Lin, Bo Zhao, Bo-Yang Zhang et al.· 4 citations
This study introduces StepAudio 3 Gen, a general-purpose audio generation model that supports zero-shot text-to-speech (TTS), voice design, vocal generation, sound effects, music, vibe speech, and mixtures of multiple audio types within a unified framework.
Bin Lin, Bo Zhao, Bo-Yang Wang et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.