Model fusion aims to integrate the capabilities of multi-expert models into a single model. Existing evaluations offer limited coverage of reasoning with long chains of thought and tool use, while strong average performance can mask substantial losses in individual expert capabilities. We introduce FusionEval, a benchm...
Shuo Cai, Yang-Gan Gu, Yuhang Liu et al.· 0 citations
MedPIC-Bench makes conditional rule application measurable and highlights the limitations of static medication-safety accuracy for assessing patient-specific reliability among medical-specific LLMs, whose average CF performance trails that of general LLMs.
Zhitian Hou, Yuhang Liu, Peng-Kai Wang et al.· 0 citations
gui-PRA is introduced, a Process Reward Agent that transforms GUI process evaluation from passive scoring into active investigation, and demonstrates strong competitiveness against fully trained critic models.
Tao Xiong, Xavier Hu, Yurun Chen et al.· arXiv.org· 5 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.