The MINERVA 2 model with DSM semantic representations performed very well and captured the key behavioral findings, and substantially outperformed a version of the model where words were represented via randomly generated vectors, and also outperformed the DSM vectors when used on their own.
This work systematically vary the context window size of GPT-2 across four large-scale naturalistic English reading-time datasets and observes a U-shaped relationship, demonstrating that tracking long-range coreference relations is one important factor for the alignment between LM surprisal and human reading behavior.
Kohei Kajikawa, Lin Ai, Tatsuki Kuribayashi et al.· 0 citations
PURPOSE
Mild cognitive impairment (MCI), a transitional state between normal aging and dementia, is associated with subtle but systematic disruptions in semantic memory, yet the representational mechanisms underlying these changes remain poorly understood. Grounded in neuropsychological evidence that semantic vulnerabi...
Qiu-Tong Chen, X. Shang, Zhen-Long Wang et al.· Journal of Speech, Language...· 0 citations
Recent research has highlighted how visual narrative sequences involve similar structures and processing as syntax in language, yet no work has asked whether these structures may interact with each other. Here we examine whether the syntactic word orders and/or headedness of languages influence the orders of particular...
This paper studies hallucinated CoT as a discourse-structural phenomenon, not only a factual one, and suggests that discourse structure provides an interpretable signal for detecting reasoning hallucinations and complements existing factuality and uncertainty-based hallucination detectors.
The results show that models’ verb representations degrade more when the authors perturb word order, which removes syntactic information, than when they perturb co-occurrence among content words, which removes semantic information.
Xiao-Meng Zhu, R. Thomas McCoy, Robert Frank· Open Mind· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.