Self-supervised learning (SSL) is standard for speech representation learning, but mainstream models are designed around single-speaker audio, limiting their usefulness in multi-speakers scenarios. We present SepRQ, an open-source SSL framework that replaces masked prediction with a pseudo-source-separation objective o...
Séverin Baroudi, Hervé Bredin, R. Marxer· 0 citations
GLaS-JEPA is presented, a framework that directly predicts the current encoder's continuous representations at masked positions, without contrastive learning, discrete targets, or separate EMA target encoders, and prevents representation collapse using SIGReg representation-space regularization.
G. Botté, Séverin Baroudi, Samir Sadok et al.· arXiv.org· 0 citations
MB using only 10% of the target-domain speech achieves word error rates comparable to, or better than, conventional ASR fine-tuning with the full dataset, indicating that small amounts of speech provide a strong modality-alignment signal.