Jul 2026
OpenLanguageModel: Readable and Composable Small-Language-Model Pretraining for Education and Research
Validation shows close agreement with independent reference implementations, 90.6% four-GPU weak-scaling efficiency for a 348M-parameter workload, compact architecture edits, and positive early usability results.
Tavish Mankash, Vardhaman Kalloli, Keshava Prasad et al.
· arXiv.org · 0 citations