Beyond Semantic Accuracy: Consequence-Aware Evaluation for Safety-Critical Language Understanding
A semantic-safety gap is uncovered in air traffic control (ATC), and conventional scores give substantially higher performance estimates than consequence-aware evaluation, even for models that appear reliable under standard met- rics.
Yujing Chang, Thinh Pham, Van-Phat Thai et al.
· 0 citations