Skip to content

Author

S. Rustamov

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Open access Jul 2026

Deep learning-based extractive and abstractive summarization for the Azerbaijani language

This article investigates extractive and abstractive text summarization for the Azerbaijani language, a low-resource and underrepresented language in natural language processing. While the underlying modeling approaches are well established, their application to Azerbaijani summarization remains largely unexplored due to the scarcity of large-scale datasets and prior empirical studies. To address this gap, we conduct a systematic evaluation of both extractive methods based on sentence ranking and an abstractive approach using a fine-tuned mT5-base model. Our experiments are carried out on a large-scale dataset comprising over 115,000 Azerbaijani news articles paired with human-written summaries. The models are evaluated using standard automatic metrics, including Recall-Oriented Understudy for Gisting Evaluation (ROUGE), Bilingual Evaluation Understudy (BLEU), and Metric for Evaluation of Translation with Explicit ORdering (METEOR), yielding strong results that highlight the benefits of task specific fine-tuning for abstractive summarization, while also demonstrating the competitiveness of extractive baselines. In addition, we analyze the impact of long input sequences and discuss architectural and dataset-related limitations affecting performance. Overall, this study provides a comprehensive empirical baseline for Azerbaijani text summarization and serves as a reference point for future research in low-resource summarization and related Azerbaijani Natural Language Processing (NLP) applications.

Mir Amir Pashayev, S. Rustamov · 0 citations
Preprint Aug 2026

Language Equality has a Price: A Systematic Investigation of Multi-turn LLM Performance for EU-24+

We evaluate large language models (LLMs) as language agents playing goal-directed dialogue games in self-play across 30 languages: the 24 official EU languages plus six others. Unlike static or preference-based evaluation, this paradigm is multi-turn, reference-free and programmatically scored, and because the game mechanics are language-agnostic it extends to a new language by localising a fixed set of prompt and word-list files. Evaluating nine open-weight and commercial LLMs, we find that no open-weight model covers the EU-24 well: in every official language both commercial systems outscore every open-weight model, and the two weakest average below 40 points across the EU-24. The commercial systems stay ahead even in languages with four orders of magnitude less public web text, showing that linguistic parity is achievable, but not from public crawls alone. A model's home region lifts it without closing the gap: Chinese is the strongest of all 30 languages for two Chinese-developed models, yet the best Chinese score of any model belongs to a US commercial system. Coverage is also not parity of service. Pooled over models and languages, the median non-English language costs 31% more to run than English, and scores 10% lower.

Sherzod Hakimov, Karl Osswald, Eszter Jelle Psurek et al. · 0 citations