Anytime-Valid LLM Leaderboards via Benchmark-weighted and Block-Factorized e-Processes
BB-EDGE (Benchmark-Weighted and Block-Factorized e-processes for Directed Graph Evaluation), a principled framework that represents an LLM leaderboard as a directed graph whose edges certify pairwise mean-performance advantages, with anytime-valid family-wise error rate (FWER) control, is proposed.
Hong-Fu Gao, Song-Xin Zhang, Ze-Jian Xie et al.
· 0 citations