This study reveals that the Deepseek-R1-Distill series models are subject to significant fluctuations caused by various factors, making their claimed performance improvements difficult to reproduce reliably.
Yong-Fu Zhu, Lin Sun, Jinzhu Wu et al.· arXiv.org· 4 citations· ⚡2
Benchmark saturation and data contamination increasingly obscure genuine scientific reasoning in frontier LLMs. We introduce \textsc{ScienceArena}, an olympiad-style benchmark from thirteen public science competitions in physics, chemistry, and biology, including IPhO and IChO 2025--2026, IBO 2023, USAPhO 2026, and USN...
Guangxiang Zhao, Qi-Long Shi, Xusen Xiao et al.· 0 citations
Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings.
Lei Bai, Jiaqi Cao, Chiyu Chen et al.· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.