Skip to content
Log in

Author

Emmanuele Chersoni

View on Semantic Scholar

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Jul 2026

Every Time I Hire a Linguist, Inference Costs Go Down: On Linguistic Rules as Effective Prompt Compressors

Prompt compression shortens LLM input to reduce inference cost, yet existing methods score token importance through LM forward passes. It remains questionable whether such nuanced, costly token selection is necessary. Compression requires identifying informative content, a problem that linguistic research has long addressed through cues that can be operationalized as deterministic rules. We therefore ask: can \textbf{linguistic rules alone} serve as effective prompt compressors, without LM-based scoring at compression time? To address this, we conduct offline evolutionary search over lexical, syntactic, semantic, and discourse seeds to find competitive rule combinations. The resulting linguistic compressor requires no LM forward pass at deployment and uses only CPU-side processing for compression. We evaluate it with a dual-path protocol to balance compression quality and reconstruction fidelity. Across short passages, multi-document reasoning, and dialogue-memory QA datasets, evolved compressors achieve performance similar to that of recent advanced prompt-compression strategies. Performance is strongest under light-to-moderate compression and degrades as compression becomes more aggressive, while the Direct and Reconstruction paths exhibit distinct patterns. Evolutionary analysis reveals that effective compression fuses signals across linguistic levels and, as the compression ratio increases, rules shift from token pruning to sentence extraction.

Jianfei Ma, Zhaoxin Feng, Emmanuele Chersoni et al. · 0 citations
Review Open access Jul 2026

Lexical semantic change detection: A survey of tasks, benchmarks, models, and potential impacts in digital humanities and social sciences

Lexical semantic change (LSC) detection investigates changes in word meaning over time, focusing on language use at the lexical-semantic level from a diachronic perspective. The field has made significant progress over the past two decades, driven by the increased availability of multilingual benchmarks, notable performance improvements, and growing interdisciplinary applications. In this paper, we review the evolution of LSC models and benchmark constructions within the context of popular shared tasks. By categorizing LSC models into generations defined by key components, our investigation suggests that performance breakthroughs have been largely driven by advances in semantic representations , transitioning from count-based models to recent transformer-based approaches. Notably, transformer models have established themselves as state-of-the-art by integrating Word-in-Context tasks, which emphasize semantic proximity in context . Furthermore, we review substantial studies that primarily leverage diachronic word embeddings to explore political, social, and cultural contexts beyond the linguistic domain. Our work provides valuable insights for future model development and encourages further interdisciplinary exploration within digital humanities and social sciences.

Jing Chen, Emmanuele Chersoni, Dominik Schlechtweg et al. · 0 citations