Language models frequently generate outputs in unintended languages or scripts, a phenomenon known as off-target generation. While existing research has focused on language selection, the dimension of script knowledge remains understudied: before any linguistic understanding can occur, users must recognize the graphic...
David Kletz, Sandra Mitrovic, Ljiljana Dolamic et al.· 0 citations
This paper investigates how script knowledge is distributed across the layers of LLMs using two complementary interpretability methods: logistic regression probing and logit-lens analysis, which show that script commitment consistently occurs at the very last layers of the LLMs.
David Kletz, Sandra Mitrovic, Itay Sabato et al.· 0 citations
This paper presents a multilingual evaluation of parity-aware to-kenization under worst-N optimization, extending PA-BPE to jointly optimize over the N worst-compressed languages.
Vani Kanjirangat, David Kletz, Tanja Samardzic et al.· Proceedings of the 1st Works...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.