Skip to content
Log in
Sponsored AI Networking Cookbook: Practical recipes for AI-assisted network automation and development AI Networking Cookbook: Practical recipes for AI-assisted network automation and development

Author

Mustafa Semih Sadak

h-index 2 View on Semantic Scholar

We have 1 of 11 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Conference Jul 2026

The Context Tax of General-Purpose Tokenization

This paper quantifies the context tax imposed by general-purpose tokenization in agglutinative languages. Using the same local Byte Pair Encoding (BPE) recipe, we train 64k native tokenizers for Turkish, Finnish, and Hungarian and compare them with tokenizers of GPT-4, mBERT, and XLM-R models. Each native tokenizer is...

Mustafa Semih Sadak · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.