When Do Surrogate Metrics Work? A Finite-Sample Comparison Under Realistic Failure Modes
Online experiments must often be evaluated before long-term outcomes mature. Under rolling enrollment, these outcomes are observed only for early enrollees, while short-term surrogates are available for everyone. We compare seven estimators across eleven data-generating processes, spanning partial mediation, drift, out...