When Quantization Preserves Accuracy but Not Evidence: Explanation-Aware Post-Training Quantization for Medical LLMs
The objective is to preserve the full-precision model's answer-supporting behavior rather than improve gold-label accuracy, and the method better preserves the full-precision model's answer behavior and rationale-to-answer support.
Yeji Kim, Mi-Young Kim, Randy Goebel
· 0 citations