Certainty Is Not Just Correctness: Rethinking Token-Level Certainty in LLM Reasoning
Token-level certainty is widely used as a proxy for correctness in LLM training and inference. However, the performance of certainty-based methods depends both on the information in certainty scores and on how those scores are used. We therefore directly assess certainty's predictive ability through controlled empirica...