Adapting Diffusion-Based Music Synthesis to Speech and Singing Voice Conversion
This work extends musical note-based conditioning to include phonetic posteriorgrams and pitch contours, and reinterpret timbre conditioning as speaker or singer identity via feature-wise linear modulation, and demonstrates that off-the-shelf feature extractors provide effective conditioning signals, enabling large-sca...