Relation Extraction from Text of Various Domains: A Serbian Case Study
Abstract
Research on Serbian named entity recognition (NER) has evolved from early rule-based approaches to neural and transformer-based models, culminating in the TeslaNER+ dataset, which contains over 150,000 sentences annotated with eight entity types and linked to Wikidata. This paper explores the use of TeslaNER+ for relation extraction (RE), focusing on identifying and classifying semantic relations between entities in unstructured text. A predefined set of relations tailored to various domains, including literary texts is employed. After analyzing existing RE schemas, 19 relevant relations are selected. The methodology combines rule-based patterns with LLM-based prompting, leveraging lexically grounded patterns and prompts derived from key terms. Experiments were conducted on a subset of 23,000 sentences, and the paper reports initial results for selected relations. The FST approach achieves a precision of 0.77 and recall of 0.39, whereas the LLM model attains a higher recall (0.97) but lower precision (0.65). These results are approximate, as they are computed on a sampled subset rather than the full dataset. In terms of efficiency, the FST approach incurs no computational cost and enables fast extraction, while the LLM approach is significantly slower and involves additional expenses.