Equivariant Music Transformer
This paper proposes the Equivariant Music Transformer (EMT), which enforces equivariance through self-distillation by jointly optimizing a next-token-prediction and an auxiliary equivariance regularization loss, and finds that the additional equivariance loss acts as a beneficial regularizer, simultaneously improving n...