Data Leakage in Speaker Credibility Features: A Systematic Analysis and Correction for the LIAR2 Fake News Benchmark
The credibility history of the PolitiFact-based LIAR/LIAR2 fake news data sets causes label leakage and inflates reported performance. This work investigates two count-construction components: 1) the aggregation scope, which involves global aggregation over the whole data set before splitting, as done by LIAR/LIAR2 (Pr...