Yihui Fu

Rethinking Language Model-Based Generative Speech Enhancement in the Latent Space of a Neural Audio Codec

Language model (LM)-based speech enhancement (SE) has recently emerged rapidly using latent space features of neural audio codecs (NACs). In this paper, first, we present a unified framework covering six popular LM-based generative SE modeling paradigms based on discrete/continuous latent NAC features: discrete or cont...