P. Smaragdis

PromptSep-Speaker: Generative Target Speaker Extraction via Multimodal Prompting and Semantic Alignment

Generative TSE model PromptSep-Speaker is proposed, a generative TSE model based on latent diffusion that unifies four interchangeable cues: speaker temporal order, transcript, enrollment audio, and speaker caption that achieves state-of-the-art performance over TSE and universal source separation baselines, improving...