OTROPE: Optimal Transport-based Robust Off-policy Evaluation for Large Language Models
The Optimal Transport-based Robust Off-Policy Evaluation (OTROPE) is proposed, a likelihood-free evaluation that performs distributional correction in a semantic space via optimal transport to align labeled behavior-policy samples with unlabeled target-policy samples, yielding a doubly robust-style evaluation.