The Dialect Tax: Dialectal Biases Persist throughout the Language Modeling Pipeline
The study traces this dialect tax across the natural language processing pipeline, suggesting that the dialect tax is encoded and accumulated not by any one step in isolation, but at every step of the language modeling process.