Penalty-Framed No-Valid-Option MCQA: Analyzing LLM Abstention under Invalid Choices
Penalty-framed no-valid-option MCQA reveals an aspect of model reliability not captured by standard answer-selection accuracy, and correct-conditioned analysis is introduced, evaluating abstention only on instances that the model originally answered correctly.
Jinhyeok Kim, Hye-Young Jung
· 0 citations