Fine-grained Approaches for Confidence Calibration of LLMs in Automated Code Revision
This study proposes local Platt-scaling applied separately to three different fine-grained confidence scores, finding that fine-grained confidence scores consistently achieve lower calibration error across a broader range of probability intervals, and this effect is further amplified when global Platt-scaling is applie...