Debojeet Ghosh

Measurement Validity and Representation Dynamics of Confidence Signals in Large Language Models

Whether a language model"knows what it knows"matters for trustworthy deployment and for deciding when it should abstain. Prior work usually measures this through one channel: verbalized confidence, a linear probe on hidden states, or agreement among sampled answers (semantic entropy), and often treats these as intercha...