Refusal-aware evaluation of frontier AI models available in June 2026 using the Japanese National License Examination for Pharmacists: a comparative study.
Overall accuracy, accuracy excluding refusals, refusal rate, refusal consistency across runs, and refusal consistency describe complementary aspects of performance; therefore, repeated, refusal-aware evaluation is needed to interpret frontier AI models in pharmacy education.
Hiroyasu Sato, K. Ogasawara, Hidehiko Sakurai
· Journal of Educational Evalu... · 0 citations