Zong-Yu Dai

Beyond Post-Hoc Temperature Scaling: Bilevel Optimization for LLM Calibration

This work proposes maximizing the entropy of predictive distributions as the calibration objective, which directly targets overconfidence by discouraging overly concentrated predictions, and adopts an efficient first-order approximation that avoids explicit second-order computation.