Not All 4-bit Quantizers Are Equal: Deployment-Time Mitigation of PII Leakage in Fine-Tuned Small Language Models
It is shown that the compression method also affects privacy, and choosing the 4-bit method is therefore a deployment-time privacy decision, not only a question of speed and quality.
Cristhian Kapelinski, Diego Kreutz
· 0 citations