Recent multimodal LLM (MLLM)-based anomaly detection (AD) methods can generate textual explanations that help interpret their predictions. However, reliably and efficiently evaluating these explanations remains challenging. While LLM judges can assess explanations through structured rubrics, they often require substant...
Qi-Zhou Wang, Jia-Wen Zhu, Guan-Song Pang et al.· 0 citations
The VEX-Bench is introduced, a unified benchmark for evaluating the verification complexity of LLM-generated misinformation, as perceived during screening, across models and generation methods, and shows that no single method dominates all dimensions, underscoring the need for multi-dimensional evaluation.
Hanxun Huang, Yu-Tao Wu, Qi-Zhou Wang et al.· 0 citations
An initial benchmark dataset is introduced, namely ASURRE, for AI-assisted survey participation to capture usage strategies ranging from full generation and revision to persona-grounded agentic completion, and it is shown that agentic completion cannot fully replicate respondent-level behaviour and leaves distinctive b...
Qi-Zhou Wang, B. Mamaev, Christopher Leckie· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.