Veerendra Kumar Sunkavalli

Does positional bias in LLM-as-judge evaluation, and its calibration fix, hold for open-weight judges?

A replication of Wang et al. (2024), "Large Language Models are not Fair Evaluators", under judge substitution. Wang, Peiyi; Li, Lei; Chen, Liang; Cai, Zefan; Zhu, Dawei; Lin, Binghuai; Cao, Yunbo; Kong, Lingpeng; Liu, Qi; Liu, Tianyu; Sui, Zhifang. "Large Language Models are not Fair Evaluators." Proceedings of the 62...