Skip to content
Open access

Minimal-Supervision Part-of-Speech Tagging for Assamese Language: An Evidence-Gated Cascade with Classifier Backfill

Jul 2026 · International journal of computer information systems and industrial management applications · 0 citations

TL;DR

This study evaluates the extent to which a length-stratified, minimally-supervised pipeline can recover tagging accuracy for the Assamese language using a labeled seed of only 3 to 5 sentences per distinct sentence length, compared to a weak-supervision classifier trained on a conventional 80% corpus split.

Abstract

Part-of-speech (POS) tagging for low-resource languages is limited more by the expense of generating labeled training data than by algorithmic constraints. This study evaluates the extent to which a length-stratified, minimally-supervised pipeline can recover tagging accuracy for the Assamese language using a labeled seed of only 3 to 5 sentences per distinct sentence length (142 to 228 sentences in total), compared to a weak-supervision classifier trained on a conventional 80% corpus split (2,840 sentences). An evidence-gated cascade is constructed, comprising Brown-style word clustering, a seed-ambiguity audit with context-based disambiguation, confidence-gated cluster labeling, and empirically validated rule fallbacks. This approach achieves 94.9% to 95.0% accuracy but only 19.8% to 20.0% token coverage from its minimal seed. To address the coverage gap, every remaining token is backfilled using a classifier trained on the pipeline’s accumulated evidence, resulting in 100% coverage at 84.7% to 86.0% accuracy (depending on seed size), as evaluated against a fixed, shared test set for direct comparison with the larger-budget baseline (90.8% accuracy, same coverage, same test set). Three negative results are reported alongside the positive findings: Brown-style clustering provides negligible benefit at this scale, Viterbi sequence decoding does not transfer to the backfill classifier from the larger-budget setting, and naive self-training fails due to confirmation bias. Additionally, through five replicated random seed draws per condition, it is demonstrated that the residual seed-size effect (3 versus 5 sentences per length, closing approximately 21% of the accuracy gap to the larger-budget baseline) is statistically significant rather than the result of a single favorable draw.

Read PDF

Similar papers

Open access Aug 2026

Ensemble-Based Approach for Amazigh POS Tagging: Leveraging Multiple Models for Enhanced Performance in Low-Resource Language Processing

The results show that hybrid ensemble methods can improve token-level accuracy in low-resource POS tagging, while also revealing a trade-off between frequent-tag accuracy and rare-tag robustness.

Abdelouahed Moussaoui, Nor-Eddine Azalmad, Said Bahassine et al. · 0 citations
Preprint Aug 2026

A Modular Part-of-Speech Tagger for Scottish Gaelic using spaCy

Using the modular spaCy Natural Language Processing framework to build part-of-speech taggers for Gaidhlig using the Annotated Reference Corpus of Scottish Gaelic, indicating that simple, off-the-shelf language processing pipelines can demonstrate good performance in low-resource and morphologically complex linguistic...

Peter Stefan, Peter J. Barclay, Alistair Lawson · 0 citations
#natural language process... Preprint Sep 2026

Correction as Annotation: Bootstrapping a Dependency Parser for Documentary Medieval Latin

Medieval documentary sources remain inadequately served by existing natural language processing tools. None of the five readily available Latin treebank models attains usable performance on a collection of 160 inventories compiled in Marseille between 1258 and 1446. The best labelled attachment score is 0.62 and the be...

G. Pizzorno · 0 citations
Preprint Aug 2026

PERCEPT: A Corpus for POS Tagging and Analysis of Persian-English Code-Mixing

This work introduces PERCEPT, the first publicly available large-scale Persian-English code-mixed corpus annotated with Universal Dependencies POS tags for code-mixed words, and conducts the first comprehensive linguistic analysis of Persian-English code-mixing across multiple social media platforms.

Ghazal Kalhor, Zahra Jafari, Amirarsalan Shahbazi et al. · 0 citations
Open access Sep 2026

Using Large Language Models for Automated Corpus Annotation and Linguistic Analysis: A Critical Methodological Framework

Large language models (LLMs) are increasingly used to classify, label, summarize, and interpret large text collections, creating new possibilities for corpus linguistics. Their capacity for zero-shot and few-shot instruction following could reduce the cost of linguistic annotation and extend analysis beyond the categor...

Maria Ibrar · 0 citations
Open access Sep 2026

Jawhar: Optimized Morphological Analysis and Contextual Reranking for Arabic Part-of-Speech Tagging

Part-of-speech (POS) tagging in Arabic is hard because its rich root-and-pattern morphology and the absence of short vowels make one unvoweled string compatible with many categories. This paper presents Jawhar, a hybrid framework that couples a high-performance morphological analyser with contextual reranking using a p...

Mohamed Bouzahir, A. A. Abdelouahad, M. Nabil · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.