Skip to content
Book Open access

Generalized Position-Based Model: Rethinking Position Weights in Ranking Off-Policy Evaluation

Sep 2026 · Proceedings of the 20th ACM Conference on Recommender Systems · 0 citations · 49 references

TL;DR

Generalized PBM is introduced, an estimator that learns position-specific weights by minimizing an approximate upper bound on the estimation error, which retains the unbiasedness guarantees of INTERPOL while significantly simplifying its hyperparameter selection.

Abstract

Off-policy evaluation (OPE) estimates the performance of new recommendation policies using logged data, thus enabling fast, safe and inexpensive iteration prior to costly A/B tests. To evaluate ranking policies, existing OPE estimators all make structural assumptions about user behavior, leading to a spectrum of trade-offs between bias and variance. The recently proposed INTERPOL estimator navigates these trade-offs through a window system that defines how clicks at different positions are combined. However, this approach has two key limitations: the window configuration must be specified a priori, which can impede practical use, and all positions within a window are weighted uniformly, regardless of their relative utility, potentially limiting accuracy. To address these gaps, we introduce Generalized PBM (GPBM), an estimator that learns position-specific weights by minimizing an approximate upper bound on the estimation error. GPBM retains the unbiasedness guarantees of INTERPOL while significantly simplifying its hyperparameter selection. Our experiments demonstrate that GPBM provides more accurate and robust estimates across a wide range of position bias misestimation levels, logging policies, and data sizes.

Read PDF

Similar papers

#machine learning Preprint Aug 2026

Adaptive Doubly Robust Off-Policy Evaluation for Ranking Policies under Diverse User Behavior

Adaptive Doubly Robust (ADR) is proposed, which combines adaptive importance weighting with re- ward regression through a control-variate correction and establishes its unbiasedness when the true user behavior model is observed and characterize a sufficient condition under which it reduces vari- ance relative to AIPS.

Kosuke Iguchi, Ren Kishimoto · 0 citations
#machine learning Preprint Oct 2026

Variance-Optimal Off-Policy Evaluation with Conjunct Effect Modeling

Off-policy evaluation (OPE) for contextual bandit policies becomes challenging when action-level importance weighting incurs excessive variance. Doubly robust (DR) estimation remains unbiased under common support but retains these high-variance action-level weights. A prior estimator, Off-policy evaluation with Conjunc...

Nicolò Felicioni, Michael Benigni, Maurizio Ferrari Dacrema et al. · 0 citations
#machine learning Preprint Oct 2026

Metropolis-Hastings Dominates Importance Resampling for Policy Composition

Post-training a large language model (LLM) often requires exploring trade-offs between multiple rewards, but retraining for each trade-off is expensive. Decoding-time policy composition allows these trade-offs to be adjusted by combining reward-specific policies at inference time. This composition targets a weighted pr...

Alexey Kurennoy, R. Yarullin, Fergal Reid · 0 citations
#machine learning Preprint Sep 2026

Efficient Offline Learning of Ranking Policies via Top-$k$ Policy Decomposition

Many recommender systems such as for e-commerce and news platforms aim to provide users with rankings they are likely to interact with. Off-Policy Learning (OPL) of ranking policies enables us to learn new ranking policies using only historical logged data. However, ranking settings make OPL remarkably challenging beca...

Ren Kishimoto, Koichi Tanaka, Haruka Kiyohara et al. · 0 citations
#machine learning Review Sep 2026

Tail-Influence Sampling for CVaR Policy Evaluation

A tail influence for each queryable conditional law that aggregates how its uncertainty affects CVaR across every Bellman reuse is derived, and an exact-grid regime in which tail- and mean-optimal allocations coincide is characterized.

P. Bourigault, Xiao-Tong Ji, Matthieu Zimmer et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.