Qian-Wen Ma

GistRank: Gist-Compressed Listwise Ranking with Large Language Models

Large language models (LLMs) have become a powerful tool for listwise relevance ranking, which can improve web search by comparing retrieved passages jointly. However, processing every candidate verbatim and generating a permutation autoregressively can make inference costly, every candidate must be serialized verbatim...