LMEnt is released to support studies of knowledge in LMs, including knowledge representations, plasticity, editing, attribution, hallucinations, and learning dynamics, finding that entity co-occurrence and mention forms—which are difficult to study with existing tools—affect learning trends.
Daniela Gottesman, Alon Gilaie-Dotan, Ido Cohen et al.· Transactions of the Associat...· 0 citations
The findings suggest that what the model knows and how it is asked are intertwined in parameter space, undermining the "knowledge base"alogy and carrying implications for the reliability and controllability of factual knowledge in LMs.
Amit Elhelo, Amir Globerson, Mor Geva· arXiv.org· 0 citations