Benoît Giniès

Multi-Rate Bandwidth Extension by Token Completion in Neural Audio Codecs

This work introduces a novel codec design that explicitly accounts for the downstream token prediction task, enabling a more effective coupling between codec structure and transformer modeling, and trains a transformer-based language model on the discrete representations produced by a disentangled neural audio codec.