No Hindsight for LLM Fact-Checkers: Measuring Leakage Channels in Misinformation Detection
As automated fact-checking scales on social media, large language model (LLM) verdict scores can look stronger than warranted. One reason is that evaluations mix in information that was not knowable at claim time. Two channels are easy to conflate: outcomes memorized in pre-training and retrieved evidence published aft...