Debias-SparseGPT: Bias-Aware Pruning for Large Language Models
Model compression techniques such as pruning and quantization facilitate the efficient deployment and acceleration of Large Language Models (LLMs). However, recent studies show that weight sparsification methods, such as SparseGPT, can amplify existing biases in models, with outputs varying significantly depending on p...
Irina Proskurina, Guillaume Metzler, Antoine Gourru et al.
· 0 citations