#artificial intelligence
Jun 2025
Evaluation is All You Need: Strategic Overclaiming of LLM Reasoning Capabilities Through Evaluation Design
This study reveals that the Deepseek-R1-Distill series models are subject to significant fluctuations caused by various factors, making their claimed performance improvements difficult to reproduce reliably.
Yong-Fu Zhu, Lin Sun, Jinzhu Wu et al.
· arXiv.org · 4 citations
· ⚡2