How Calibration Content Shapes Attention-Based Reranking
Attention-based rerankers score documents by aggregating query-to-document attention and subtracting a null-query calibration pass to remove positional and structural bias. Although widely used, this calibration assumes that the null pass removes irrelevant signal from each document. We show that modern prompt content,...
Petros Karypis, Hossein Rajaby Faghihi, Peter Chen et al.
· 0 citations