RAGWarrant is presented, an open-source promotion-control framework that treats deployment as a constrained evidence decision rather than a leaderboard choice and claims an auditable promotion-control abstraction, not optimizer superiority, human validation, or production readiness.
Richard Krueger, L. Krause, Zach Pocquette· 0 citations
The shipped Laya Typed-Decisions checkpoint, a 421M-parameter ModernBERT-large assessor that answers typed choice/noul/score questions over workflow state, is uniformly under-confident. The signed confidence-accuracy gap is $-0.214$, every occupied reliability bin's accuracy exceeds its confidence, and that sign unifor...
LLM agents increasingly take consequential actions through interactions with users, policies, and external tools. Auditing these agents requires automated attribution of realized actions to their historical basis. However, existing attribution formulations do not provide question-specific traces for diverse auditing ob...
Yi-Fan Liu, Praveen Venkateswaran, Abdulhamid Adebayo et al.· 0 citations
This work introduces Audit-First VAPO, which separates discrete directional admission from continuous magnitude control, and evaluates two models on two reasoning benchmarks against static RLVR, matched-random selection, confidence thresholding, noise correction, and verifier augmentation.
Miao-Bo Hu, Shu-Hao Hu, Xiao-Bo Guo et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Investigation to Act (P2A) is introduced, an active probing framework for the browser-agent loop that addresses an asymmetric bridge between symbolic DOM hypotheses and screenshot layout by rendering on-demand symbolic DOM structure back into pixels.
Ke-Liang Li, Heng Wang, Chen Hu et al.· 0 citations
Language model agents are increasingly deployed in open-world tool environments, which require balancing exploring unknown capabilities and exploiting known ones. Existing methods face a performance-efficiency tradeoff: they either rigidly decouple exploration and execution or interleave them without coordination. We a...
Shengbin Yue, Hongru Wang, Siyuan Wang et al.· 1 citation
Raven is introduced, an open-source multi-agent ecosystem that automatically constructs and evolves modular harnesses for specific models and domains, treating each executable model--harness pair as a composable unit of intelligence.
This work proposes to optimize the benchmark generation workflow itself end to end with MetaBench-Harness, a dual-loop search framework that enables multi-dimensional evolution, steadily improving evolution reasonableness, benchmark competency, and evaluator robustness across successive rounds.
Xuan-Jun Chen, Hua-Hsuan Chen, Wei-Chung Lu et al.· 0 citations
An agent can complete a task while exhibiting undesirable behavior during execution. Developers need tests for the specific behaviors encountered in deployment, beyond fixed benchmark suites. We present TraceDance, an agent system that constructs targeted benchmarks from deployment traces for user-specified undesirable...
De-Hai Min, Dao-An Zhang, Yiming Zeng et al.· 1 citation
This work proposes Self-Evolving Online Policy Distillation (SeOPD), which enables LLMs to distill and internalize information generated by their own chain of thought (CoT), thereby improving both non-thinking and deep-thinking capabilities.
Xiao-Shu Chen, Si-Hang Zhou, K. Liang et al.· 0 citations
An evaluation is built that scores trust and completion on the same runs, in a simulated world of businesses with their own websites, inboxes, and phone lines, and of people who write back, to measure Fo, Wajo's personal assistant, against a base model with basic instructions on three foundation models, and against the...
Jeroen Olieslagers, Eduardo E. P. Pujol, Gal Zahavi et al.· 0 citations
PaR stays on the observed cost-accuracy frontier, matches a sink-frontier heuristic in accuracy at comparable cost and a faithful FrugalGPT cascade at lower cost, and cuts cost 44% against all-frontier routing while giving up 2.9 points of accuracy.
V. Singh, Preeti Priyam, Gautam Bhowmick· arXiv.org· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.