MAWILE: Multi-Axis Workbench for Inspecting LLM Evaluators
Large language model (LLM) judges provide a flexible and scalable method for evaluating model and agent outputs, but their verdicts can be sensitive to incidental changes in the evaluated response, judge instructions, and scoring rubric. Existing systems examine important subsets of these failure modes, but auditing a...
Jackson Hassell, Farima Fatahi Bayat, Pouya Pezeshkpour et al.
· 0 citations