Aug 2026· Intelligent Data Analysis· 0 citations· 28 references
TL;DR
LLM-assisted sense assignment with a Serbian WordNet-based custom inventory, iterative inventory expansion, and expert validation is combined with a constrained JSON-formatted output to support the practical construction and refinement of sense-annotated resources in a low-resource setting.
Abstract
Word Sense Disambiguation (WSD) remains a challenge in natural language processing, particularly for morphologically rich and less-resourced languages, e.g., Serbian, where complex inflectional systems intensify lexical ambiguity. Existing WSD approaches often struggle because of scarce annotated corpora, inadequate sense inventories, and linguistically complex languages. This paper presents a semi-automated framework for Serbian WSD resource development that employs Large Language Models (LLMs) and a constrained JSON-formatted output. The approach combines LLM-assisted sense assignment with a Serbian WordNet-based custom inventory, iterative inventory expansion, and expert validation, with the aim of supporting the practical construction and refinement of sense-annotated resources in a low-resource setting.
In WSD experiments, LLMs significantly outperformed the Serbian-specific
TeslaXLM
, the multilingual embedding model
intfloat/multilingual-e5-large
, and the sentence transformer
all-MiniLM-L6-v2
. The expanded sense inventory improved the accuracy, particularly for
GPT-4.1
, which achieved 92.4% for single-word and 95.2% for multi-word spans. These results position LLMs as potentially practical for scalable sense-annotated data creation in less-resourced settings.
The proposed methodology addresses key limitations in existing WSD pipelines for Serbian, and contributes to the broader effort of adapting LLMs for semantic processing in linguistically diverse and data-scarce environments.
Inspicio is presented, an open-vocabulary retrieval pipeline that links tokens in context to synsets of the Open English WordNet (McCrae et al., 2020) without requiring any source-language inventory or mapping.
This paper proposes automated methods to construct high-quality WordNets using large language models (LLMs) to generate missing lemmas to address the synset shortfall in non-English and low-resource languages.
Johann Bergh, J. Waitelonis, Melanie Siegel· 0 citations
The proposed k-Multilingual Concept model allows to uncover novel layers of lexical knowledge in the form of multifaceted conceptual links between naturally disambiguated sets of words.
Francesca Grasso, Vladimiro Lovera, Luigi Di Caro· 0 citations
Word-in-Context (WiC) remains challenging for language models, despite recent progress on lexical-semantic tasks. We hypothesise that this difficulty arises not only from comparing two contextual uses of a word, but also from the absence of an explicit sense inventory that specifies the relevant level of semantic granularity. We evaluate open LLMs on WiC and traditional Word Sense Disambiguation (WSD) under similar settings. We find that providing candidate senses, similar to what is done in traditional WSD, improves WiC performance in all settings. In general, explicit sense information helps models make more consistent and targeted judgements. Human evaluation further shows that many apparent WiC errors reflect label ambiguity or mismatches between model and annotator sense boundaries rather than simple failures of lexical understanding. In particular, results show that LLMs overthink the sense distinction often leading to errors based on overly fine-grained distinctions.
Yi Zhou, Kiamehr Rezaee, D. Bollegala et al.· 0 citations
Multilingual large language models (LLMs) are increasingly used for open-ended text generation, yet their behaviour in low-resource languages remains poorly understood. In this work, we question how correct and reliable is the generation of multilingual LLMs when used for the task of story generation. We consider Urdu language as a representative low-resource language. We generate Urdu-Stories, a corpus of 93 stories generated using three contemporary LLMs (GPT-5.1, Qwen-3-Max, DeepSeek-3.1). We manually annotate the errors present in them under a nine-label linguistic, semantic, and cultural taxonomy. Our notable findings suggest that LLMs often make basic errors of grammar and semantics. The stories lack coherence, have unnatural repetition and show pervasive cultural shallowness. We further show using few-shot prompting that the cultural and context errors largely remain unresolved. Our findings highlight the limitations of current LLMs as a reliable source of content generation and information retrieval for low-resource languages.
Farah Adeeba, A. Khan, Rajesh Bhatt et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.