Selective Knowledge Edit Reversal via Gated Singular Vector Shrinkage
Results suggest that different edits are sparsely encoded within dominant singular components and can be separable when the number of edits is moderate, making selective spectral reversal a promising direction for locating edit-specific components and repairing edited language models.
Wei-Feng Jiang, Rui-Rui Chen, Qian-Ren Mao et al.
· 0 citations