Idioms have long been a challenge for machine translation, and while large language models (LLMs) have proven increasingly adept at handling them, whether quality estimation (QE) systems have kept pace and can reliably score idiomatic renderings of these expressions above faulty literal ones remains unclear. We introdu...
Malik Marmonier, Benoît Sagot, Rachel Bawden· 0 citations
Existing automatic metrics for evaluating terminological use in machine translation (MT) penalise any divergence from a fixed reference, conflating translation errors with the valid terminological variation that human translators routinely produce. We introduce TermJudge, a document-level terminology metric that assign...
Nicolas M. Dahan, Franccois Yvon, Rachel Bawden· 0 citations
It is argued for variation-aware evaluation that conditions consistency penalties on whether target-side variation mirrors source-side variation, and constraining MT with a glossary improves accuracy and consistency but degrades CTV by suppressing valid variation.
Nicolas M. Dahan, Ziqian Peng, François Yvon et al.· 1 citation· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.