Ujjwal Singh Rao

How Much Junk Do Rules Catch? Evaluating and Tuning pygarble, a Dependency-Free Gibberish Screener, on Survey Responses and Social-Media Text

Text that reaches a language model, a survey database or a training corpus is not always text. Keyboard mashing, random strings and placeholder answers are common, and the usual detectors for them are either trained classifiers with model downloads or hand-written rules that are rarely measured. pygarble is a Python li...