Across several reasoning tasks and model families, the proposed frontier learning approach consistently achieves higher relative gains over fixed-pool baselines, demonstrating that effective post-training requires not only selecting useful problems, but continually generating them at the edge of capability.
Robin Faro, S. Ramesh, Ilija Bogunovic et al.· 0 citations
Constrained decoding can enforce regular or context-free output formats, but many program-generation failures are semantic: scope, typing, and declaration effects depend on context. We present semantic grammar specifications, a declarative formalism that attaches such constraints to a context-free surface and executes...
Paul Kronlund-Drouault· Proceedings of the 2nd ACM S...· 0 citations
This work introduces AwarenessBench, the first comprehensive benchmark for assessing the cognitive abilities of LMs in four dimensions: metacognition, self-awareness, social awareness, and situational awareness, covering 15 cognitive functions and 14,381 samples.
Xiaojian Li, Rongwu Xu, Tianyun Zhang et al.· Annual Meeting of the Associ...· 0 citations
This work presents a first study of how hybrid attention impacts the multilinguality of LLMs, showing that cross-lingual representations in hybrid models develop in patterns tied to the ordering of recurrent and full-attention layers.
Lucas Bandarkar, Jun-Ling Hu, Chen-Yuan Yang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Coding agents are increasingly deployed for iterative development on real repositories, yet existing evaluation barely answers a basic question: \emph{do coding agents reuse existing code or reinvent the wheel?} The question matters: every duplicated implementation is a fix applied twice and agents produce code far fas...
Dong-Sheng Ma, Si-Zhe Wang, Xin-Yi Huang et al.· 0 citations
An expert-driven methodology for constructing such alignment data and applying it to a normative framework grounded in Islamic ethical, theological, and jurisprudential traditions is presented.
H. Sencar, Rezart Beka, D. Naeem et al.· 0 citations
Across three model families, two small groups of attention heads are identified with distinct roles in introspective reporting supporting introspective detection and localization of large language models.
Jia-Hong Zou, Xiang-Kun Sun, Ling-Kai Kong et al.· arXiv.org· 0 citations
Evaluations of Large Language Models (LLMs) morality typically consider decisions in isolation, thus overlooking whether an individual's unrelated prior conduct influences the model's subsequent choices. This leaves open the question of whether, and to what extent, moral history shapes LLM decisional behaviors. Prior w...
The VEX-Bench is introduced, a unified benchmark for evaluating the verification complexity of LLM-generated misinformation, as perceived during screening, across models and generation methods, and shows that no single method dominates all dimensions, underscoring the need for multi-dimensional evaluation.
Hanxun Huang, Yu-Tao Wu, Qi-Zhou Wang et al.· 0 citations
A single encoder trained contrastively to isolate the targeted fact, utilizing synthetic data generated by an LLM and dataset both disjoint from all evaluation settings improves performance on 120 of 126 evaluation settings (95%) spanning 18 model dataset combinations across language and vision-language models.
Joseph Hoche, Quentin Guimard, Gianni Franchi· 0 citations
CREDO reads the confidence from a dedicated token pair in the model's output distribution and trains it by differentiable regression, turning the trained confidence into a signal for accuracy, weighting rollouts by how far confidence and outcome disagree, so that accuracy and calibration improve together.
Chen-Xiao Fan, Chong-Ming Gao, Gang-Yi Zhang et al.· 0 citations
DivOPD, a simple learner-side batch-selection method that spreads a fixed turn budget across more rollouts and, within each rollout, prioritizes turns with larger cumulative teacher-student disagreement, is introduced.
Han-Yang Wang, Ze-Yuan Liu, Zheng-Yu Chen et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.