A Prosody-Aware Dual-Stream Neural Model designed for speaker-adaptive voice command recognition, enabling robust classification of short voice commands in real-world conditions and confirming that the combination of acoustic and prosodic information provides a more stable and adaptive representation of speech.
Real-time voice conversion (VC) systems commonly rely on pretrained speaker embeddings from automatic speaker verification (ASV) models. While effective for speaker discrimination, these embeddings are trained to remain stable across phonetic and prosodic variations within-speaker, which may conflict with frame-level a...
Mu-Ruei Tseng, Waris Quamer, Ghady Nasrallah et al.· 0 citations
A Conditional Speaker Normalization module is introduced that conditions the normalization process on speaker embeddings derived from either speaker verification systems or a speaker-height estimation model to mitigate the speaker-dependent nature of Log-Area Ratios.
The transition from vocoder-based to neural-codec speech synthesis makes generalization more difficult for speech deepfake detectors, particularly those relying on speech-oriented representations. It remains unclear which acoustic representations retain discriminative information when the generation mechanism changes....
Speech understanding and generation place different demands on speech representations, and existing models are typically optimised towards one capability or the other. To reduce this gap, we introduce SPEAR-Gen, a speech representation model that learns a single representation for both capabilities. Task-aligned featur...
Xiao-Yu Yang, Arthur Hinsvark, Antonios Alexos et al.· 0 citations
It is shown that fine-tuning a non-autoregressive architecture, such as ForwardTacotron, achieves speaker-adaptation quality comparable to zero-shot methods, with lower computational complexity but a lower mean opinion score.
Kishor Kayyar Lakshminarayana, Frank Zalkow, Christian Dittmar et al.· Journal on Audio, Speech, an...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.