Overfitting Mitigation via Singular Value Decomposition in Minimum Bayes Risk Decoding
This work introduces SVD-MBR, which frames the pairwise utility matrix as a noisy information signal, and reveals that this denoising is metric-dependent: neural metrics encode a robust low-rank consensus ideal for SVD, whereas surface-level metrics struggle to separate signal from metric noise.