Characterizing LLM performance via a Bayesian lens
A hierarchical Bayesian Beta-Binomial framework for uncertainty-aware evaluation of LLMs on multiple-choice datasets, providing deeper insights into accuracy, consistency, and heterogeneity essential for reliable model benchmarking.