Beyond BLEU: A Case for Redefining Sign Language Translation Benchmarks
This work introduces an alternative inspired by language-learning assessment, using an open-weight-LLM QA protocol that measures salient content preservation that aligns more closely with human rankings and is six to seven times more paraphrase-invariant than BLEU-4.
Oline Ranum, Edward Fish, Simon Hadfield et al.
· 0 citations