Skip to content

Author

Colin A. Raffel

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Nov 2026

MoTo: Mixture of Tokenizers Towards Fair Multilingual Language Modeling

Large language models rely on a single tokenizer that is chosen at training time and fixed thereafter. Most tokenizers are trained on English-dominant corpora, making them under-serve morphologically rich and non-Latin-script languages, where they can produce fragmented representations, longer sequence lengths, and red...

G. Altintas, Colin A. Raffel · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.