The North Small Translate model is presented, an open-weight, LLM-based machine translation (MT) model with instruction-following capabilities built on the same foundation as Cohere's Command A Plus, a mixture-of-experts architecture with 25 billion active parameters out of 218 billion total parameters.
Tom Kocmi, Alexandre Berard, P. Blunsom et al.· 0 citations
Pearmut is introduced, a lightweight yet feature-rich platform that makes end-to-end human evaluation as easy to run as automatic evaluation and enables reliable human evaluation to become a practical, routine component of model development and diagnosis rather than an occasional effort.
Vilém Zouhar, Tom Kocmi· arXiv.org· 11 citations· ⚡2
This work formalizes multi-model human evaluation as a best-arm identification problem in a multi-armed bandit setup with correlated arms, where pulling an arm corresponds to human-evaluating a model, and proves the optimality of the proposed algorithms and shows that it improves discrimination between top-performing m...
Vilém Zouhar, Julia Kreutzer, A. Lavie et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.