Beyond Raw Engagement: A Counterfactual Observability Framework for Recommender Systems at Netflix
Understanding the performance of large-scale recommender systems remains an underexplored challenge, especially for content creators and model developers. The raw engagement signals available to them, such as views and clicks, conflate content quality, model behavior, presentation bias, and audience reach, making it ha...