When an LLM judge scores an output, its score distribution retains uncertainty and disagreement information that is lost after scalar compression. We introduce JudgeMoE, a lightweight aggregator that assigns example-specific weights to cached judge score distributions and fuses them before computing a final score. A pr...
Yiqi Liu, Joseph James, Yang Wang et al.· 0 citations
When a language model refuses to answer a prompt, it is unclear whether the correct answer is erased from its internal representations, or merely suppressed at the output layer. We investigate this mechanism using a controlled withhold setting, which yields perfectly matched answering and refusal trajectories for bidir...
Yiqi Liu, Yang Wang, Songxin Wang et al.· 0 citations
Existing auto-research benchmarks often entangle multiple sources of improvement, including training frameworks, hyperparameters, compute budgets, and data, making it difficult to attribute why one frontier agent outperforms another to specific research capabilities. In this work, we isolate and systematically evaluate...
Rui-Feng Yuan, Yi-Zhi Li, Ya-Xin Du et al.· 0 citations
This work proposes ToolScout, a source-aware routing method that uses query-side TF-IDF fingerprints flag source styles on which the fine-tuned retriever is likely to fail better than semantic or length-based proxies, giving a cheap signal for mismatch over a fixed tool corpus.
Yiqi Liu, Joseph James, Yang Wang et al.· 2 citations
A benchmark for evaluating whether models can infer the implicit, non-linear, and rhetorically layered meanings of social media videos that appear nonsensical on the surface but convey deliberate pragmatic meanings, and a diagnostic setting for measuring the gap between multimodal perception and pragmatic comprehension...
Yang Wang, Ya-Nan Ma, Yiqi Liu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.