Commutator memory is defined per source pair, not per example, and its projection on $b_{AB}$ decays with further training, which identifies which came from which order in 92% of cases across four LLMs (chance 50%).
Video-language models are increasingly used as judges of video understanding, both for evaluating model outputs and for training reward models. Whether their judgments remain reliable when the evidence is buried in day-long videos has yet to be established. Existing benchmarks cannot answer this. Their videos are typic...
Analysis of rubric-grounded credit suggests more efficient evidence acquisition and higher-quality reports under limited research-turn budgets, motivating the extension of rubric-grounded process supervision to a broader range of rubric-based tasks.
Ying-Jian Zhu, Zhen-Yi Wang, Jia-Xing Guo et al.· 0 citations
LLM pretraining corpora are normally cleaned by a stack of hand-written heuristics. A heuristic scraper extracts the main content from HTML, and dozens of rule-based filters then clean it, so corpus quality is capped by the coarseness and accuracy of the rules. In this work, we propose ReScraper, a unified language mod...
Zichun Yu, Jiarui Yan, Shlok Sanghvi et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
CHORD (Coherence-aware Hidden-state Open-generation Reference Distance), a coherence-sensitive distributional metric, is introduced to establish representation design as central to reliable distributional evaluation.
Jin-Nuo Liu, Jun-Hao Zhu, Wei-Feng Jiang et al.· 0 citations
The strong version of the stochastic parrot argument claims that, although large language models (LLMs) may exceed rote regurgitation, they cannot move beyond statistical pattern matching into abstraction or reasoning, remaining ontologically near the lower bound of pattern reuse despite producing alluringly fluent tex...
J. Zimmerman, C. Beauregard, Tabia Tanzin Prama et al.· 0 citations
Large language models (LLMs) increasingly mediate how people access and reason with information, yet factual reliability is usually evaluated one judgment at a time. We introduce graded belief stability, a relational measure of how well a belief persists within an LLM's broader belief system. Unlike individual belief p...
Samantha Dies, Branden Fitelson, Tina Eliassi-Rad· 0 citations
This work tests whether separating three-state extraction (present, absent or unknown, by an LLM) from decision logic (deterministic code computing score bounds over unknown inputs) lets a system ask only questions that can change the decision.
Names are personal identifiers, but they also carry social meaning and are widely used to evaluate how language models treat different people, so it is shown that this assumption often fails at the lexical interface: matched names are not necessarily matched inputs.
Mir Tafseer Nayeem, Davood Rafiei· arXiv.org· 0 citations
This work presents a diagnostic and optimization framework grounded in a key empirical finding: the value of tokens within a CoT reasoning sequence is highly non-uniform, and this non-uniformity can be effectively characterized by token-level log probability signals.
Run-Jia Zeng, Hang Hua, Yiyang Liu et al.· 0 citations
A single random Gaussian probe gives an unbiased estimate of the squared Frobenius norm of a layer's quantization error. The estimator is well-behaved because round-to-nearest error is spectrally flat. Across 1,683 tensors from a 35B MoE and a 9B dense model, effective dimensionality is 0.93 to 0.96 times the i.i.d. no...
Verifiable QA Generation for Self-Evolving Models (VQS) is presented, which changes how the model judges answers and improves Qwen3-VL by up to 3.18 points at the 2B, 4B, and 8B scales and outperforms the strongest self-evolving baseline at each.
Ahmed Heakl, Sungik Choi, Moontae Lee et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.