Enhancing Assessment of Self-Consistency in LLM Explanations using Perturbation Strength
This work proposes an LLM-as-a-judge approach to measure perturbation strength in a unified manner across input and CoT perturbations and suggests that judgments about a model's self-consistency is fair only within the same perturbation type.
P. Le, Kemal Kurniawan, Jey Han Lau
· 0 citations