High-Level Text Preprocessing for Semantic Similarity Analysis of Discursive Texts: A Framework and Empirical Demonstration
High-level text preprocessing is introduced: a systematic, rule-based intervention applied before the standard preprocessing pipeline to isolate each document's actual claim from its discursive structure and introduces the semantic diffusion index (SDI), a per-document metric for assessing the semantic reorientation be...