Quantization-Robust Unlearning through the Lens of Retain-Forget Loss Landscapes Interaction
Unlearning ensures LLM compliance by removing the influence of private or copyrighted training data. However, since LLM models typically undergo post-training compression, like quantization, in practical deployment, it has been observed that the unlearning effect can be substantially weakened, with the forgetting behav...
Jia-Lu Wang, Jia-Ning Deng, Shu-Qing Luo et al.
· 1 citation