MI-MIDI 2: From Observation to Control with Sparse Autoencoders in Text-to-MIDI Generation
Sparse autoencoders (SAEs) can expose features of a generative model without predefined labels, but in language models the evidence used to interpret these features has proven an unreliable guide to which of them steer the output. Whether interpretations of SAE features predict control in music generators has not, to o...