Data-Efficient Adaptation of Multilingual LLMs to Ukrainian
Yurii Paniv, Bohdan Didenko, Mykola Haltiuk et al.
· 3 citations
2 papers indexed here
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
Preprint
Aug 2026
Writing-System-Level Tokenizer Adaptation for Byte-Level BPE
Pretrained byte-level BPE tokenizers can segment underrepresented languages inefficiently. Replacing a tokenizer changes the meaning of nearly every token ID, while vocabulary expansion enlarges the model's embedding and output matrices. We study post-hoc adaptation that keeps the model-vocabulary size fixed and preser...
Bohdan Didenko
· 1 citation