Human pairwise comparisons provide a reference for evaluating large language models (LLMs), but collecting sufficient judgments for each new release is costly and time-consuming. LLM judges offer a scalable alternative, although their comparisons may differ systematically from human preferences and across judges. We st...
Xin Zhou, Si-Nian Zhang, Zhan-Yan Yang et al.· 0 citations
FUSHAP is proposed, a method that leverages partially-observed auxiliary sites to reduce the variance of a preliminary single-site Shapley estimate without imputation and reduces MSE on multi-site air quality and multi-center clinical data.
Siqi Li, Wang-Xuan Fan, Yi-Ming Li et al.· 0 citations
Cross-fitted estimators that transport information from the two labeled sources through source-specific density ratios are proposed that establish asymptotically linear inference for TPR and FPR, consistency and pointwise inference for the ROC curve, and asymptotically normal inference for AUC.