Skip to content

SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering

Aug 2025 · arXiv.org · Vol abs/2508.03448 · 11 citations · ⚡ 1 influential · 68 references
Computer Science Engineering

TL;DR

This paper introduces SonicMaster, the first unified generative model for music restoration and mastering that addresses a broad spectrum of audio artifacts with text-based control and significantly improves sound quality across all artifact categories.

Abstract

Music recordings often suffer from audio quality issues such as excessive reverberation, distortion, clipping, tonal imbalances, and a narrowed stereo image, especially when created in non-professional settings without specialized equipment or expertise. These problems are typically corrected using separate specialized tools and manual adjustments. In this paper, we introduce SonicMaster, the first unified generative model for music restoration and mastering that addresses a broad spectrum of audio artifacts with text-based control. SonicMaster is conditioned on natural language instructions to apply targeted enhancements, or can operate in an automatic mode for general restoration. To train this model, we construct the SonicMaster dataset, a large dataset of paired degraded and high-quality tracks by simulating common degradation types with nineteen degradation functions belonging to five enhancements groups: equalization, dynamics, reverb, amplitude, and stereo. Our approach leverages a flow-matching generative training paradigm to learn an audio transformation that maps degraded inputs to their cleaned, mastered versions guided by text prompts. Objective audio quality metrics demonstrate that SonicMaster significantly improves sound quality across all artifact categories. Furthermore, subjective listening tests confirm that listeners prefer SonicMaster's enhanced outputs over other baselines.

View source

Similar papers

Preprint Sep 2026

RESTORE: REal-time Steerable Music resTORation and bandwidth Extension via stem disentanglement

Neural methods for audio restoration are typically framed as rigid mappings from degraded inputs to single clean outputs, enforcing decisions about what audio content is removed, and potentially adding unwanted content to the restored signal. Because what constitutes a restored audio signal is subjective, we introduce...

Mei-Ying Chen, Benjamin R. Thompson, Michael C. Heilemann · 0 citations
#artificial intelligence Preprint Sep 2026

Hi-Singers: A Comprehensive High-Quality Dataset for Expressive Audio-Driven Singing Head Synthesis

State-of-the-art models for audio-driven digital human generation have achieved photo-realistic results in talking-head synthesis. However, extending these models to singing-head synthesis remains challenging due to a significant Domain Gap: singing requires more exaggerated expressions, vivid jaw openings, and precise...

Yi-Chi Zhang, Hui Zhang, Guan-Jun Liu et al. · 0 citations
Preprint Sep 2026

DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generation

DiffSynth-Music is introduced, a framework that adds composable audio conditioning to a music synthesis backbone through layer-wise key-value injection and releases the three template models, Control, Prosody, and Reference, to support research and creative applications in controllable music generation.

Zhong-Jie Duan, Sheng-Chuan Gao, Hong Zhang et al. · 0 citations
Aug 2026

Generalized Audio-driven Synthesis of Precise Drummer Motion

This paper introduces a generative diffusion framework featuring a dual-objective loss function that decouples skeletal integrity from drumstick precision, thus enabling centimeter-level stick precision without sacrificing natural body dynamics.

Á. Iñesta, Mattia Ryffel, A. H. Bermano et al. · 0 citations
Preprint Sep 2026

PhaseGAN: High-Fidelity Vocoder via Decoupled Amplitude and GAN-Driven Phase Reconstruction

A vocoder is a pivotal component of modern text-to-speech (TTS) systems. Despite the significant progress of neural network-based vocoders, accurate phase reconstruction remains the main challenge limiting both audio quality and modeling efficiency. We introduce PhaseGAN, a lightweight vocoder that addresses this limit...

Wenzheng Zhang, Xue-Liang Zhang, Shu-Lin He et al. · 0 citations
Open access 2026

S2X-Net: Stereo-to-Multichannel Neural Upmixing Network

While the stereo format is the most common representation for audio in general, it cannot provide a complete immersive audio experience due to its lack of surround sound. For this reason, multi-channel configurations such as 5.1 or 7.1 are used in cinema or home studios, offering an improved sonic sensation. However, c...

Marian Negru, Bogdan Moroșanu, A. Neacsu · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.