Yu-Ting Tang

ProbabilityBench: Model Evaluation and Calibration with Exact Ground-Truth Uncertainty

Evaluating model uncertainty on real-world data is challenging because each instance provides only a single observed label, leaving true conditional class probabilities unknown. To address this, we introduce ProbabilityBench, a benchmark that provides exact, instance-level class probabilities across three simulated tex...