Modern Information Retrieval (IR) systems, including small and medium-scale ones, often search across millions of documents. In many cases, data owners outsource retrieval to a third-party host to keep the data accessible. Furthermore, IR has also moved toward semantic matching with dense embeddings; although these emb...
F. D. De Faveri, Guglielmo Faggioli, Nicola Ferro· Proceedings of the 35th ACM...· 0 citations
Large language models (LLMs) are increasingly used to produce the relevance labels that underpin the evaluation of information retrieval (IR) and retrieval-augmented generation systems. Yet delegating relevance assessment to an LLM raises a meta-evaluation question that is hard to answer with existing resources: when,...
Hossein A. Rahmani, Clemencia Siro, Mohammad Aliannejadi et al.· Proceedings of the 35th ACM...· 0 citations
New approaches based on the recently proposed Dimension IMportance Estimators (DIMEs) are introduced, incorporating LLM-generated relevance judgments into the re-ranking process, showing that even a few noisy relevance judgments from small LLMs can provide a powerful signal to improve the effectiveness of IR systems.
Andrea Pasin, Guglielmo Faggioli, Nicola Ferro et al.· Proceedings of the 35th ACM...· 0 citations
New approaches based on the recently proposed Dimension IMportance Estimators (DIMEs) are introduced, incorporating LLM-generated relevance judgments into the re-ranking process, showing that even a few noisy relevance judgments from small LLMs can provide a powerful signal to improve the effectiveness of IR systems.
Andrea Pasin, Guglielmo Faggioli, Nicola Ferro et al.· Proceedings of the 35th ACM...· 0 citations
A new PPIR research agenda is proposed to address the unsolved problem of private data use and access and includes novel privacy research pillars aimed at addressing objectives grounded in gaps in the literature, user survey findings, and structured interviews with experts from research, industry, and regulatory bodies...
Francesco Luigi De Faveri, Guglielmo Faggioli, Asia J. Biega et al.· Annual International ACM SIG...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.