This work develops a reproducible pipeline for cleaning, processing, and parsing Thai text under the Universal Dependencies framework and releases a frequency lexicon and CoNLL-U parses in machine-readable formats suitable for both AI-assisted and conventional programmatic analysis.
Abstract
Studying syntactic patterns in naturally occurring language requires a large parsed corpus, but manual annotation is costly and difficult to scale. Thai has a manually annotated dependency treebank for training and evaluating parsers, but lacks a large automatically parsed corpus for quantitative syntactic research. We present ThaiTrees, a 342M-token corpus drawn from news, Wikipedia, spoken transcripts, and social media. We develop a reproducible pipeline for cleaning, processing, and parsing Thai text under the Universal Dependencies framework. The resulting corpus makes grammatical relations searchable and supports the study of syntactic distributions. We release a frequency lexicon and CoNLL-U parses in machine-readable formats suitable for both AI-assisted and conventional programmatic analysis.
We present edition 2.0 of the PARSEME multilingual corpus annotated for multiword expressions (MWEs), resulting from efforts of the PARSEME community towards universality-driven modeling of idiomaticity. With respect to previous editions, we extend the annotation scope to all syntactic MWE categories: verbal, nominal,...
Agata Savary, Manon Scholivet, C. Ramisch et al.· International Conference on...· 3 citations
As natural language corpora expand at an unprecedented rate, manual
annotation remains a significant methodological bottleneck in corpus linguistic work. We
address this challenge by presenting a scalable pipeline for automating grammatical
annotation using large language models (LLMs). We demonstrate the pipeli...
Cameron Morin, Matti Marttinen Larsson· International Journal of Cor...· 0 citations
Chunking is an important NLP task that identifies non-overlapping syntactic phrases such as noun and verb phrases without constructing a full parse tree. For low-resource and morphologically rich languages like Gujarati, chunking remains challenging due to flexible word order, limited annotated data, and insufficient l...
Jigisha Purohit, K. Patel· International Workshop on Ar...· 0 citations
This article argues against unvalidated full automation and proposes selective automation, disagreement-based human adjudication, model/version documentation, and preservation of raw outputs for corpus research and develops a validated human–LLM workflow for corpus research.
Maria Ibrar· International Journal Of Lit...· 0 citations