LLM agents can make unsafe tool calls even when instructed to behave safely. Existing defenses constrain agents before execution, modify tool inputs/outputs, or rely on LLM judges; these approaches may depend on model behavior or block unsafe actions without helping the agent recover. We argue that the execution enviro...
Charlie Summers, Prajwal Raghunath, Aaditya Pai et al.· 0 citations
This work formalizes the task as structured prediction of (skill, level) pairs from free text and asks three questions: how accurately can text be mapped onto SFIA's closed vocabulary, which strategies reliably predict the level alongside the skill, and do agentic designs improve on simpler retrieval and prompting?
Ranuga Disansa, U. Samarasinghe, Lasith Gunawardena· 0 citations
Training a language model on data with a narrow flaw can sometimes make the model broadly misaligned. Inspecting the data at face value often does not settle whether it will emerge, and today it is caught only after training, by auditing the resulting model. To complement post-hoc audits, we introduce Alignment Forecas...
Chen Yueh-Han, Bruce W. Lee, Ilia Sucholutsky et al.· 0 citations
It is shown that contrary to previous studies, perturbations can mitigate bias and hallucination in some LLMs over other models, and it's found that Claude 3 is more effective for the tasks represented in most datasets, whereas models like GPT3.5 exhibit varying levels of adequacy.
Mamehgol Yousefi, Ahmad Shahi, Mos Sharifi et al.· International Conference on...· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
While neural theorem provers have achieved impressive milestones in formal mathematics, they largely operate on the assumption that faithful Lean 4 formal statements are already provided. Translating informal natural language into a formal language is a critical data bottleneck plagued by an "illusion of rigor": standa...
Thomas Hirtz, Farzad Jafarrahmani, Abdelmouksit Sagueni et al.· 0 citations
Across Harness-Bench and NewtonBench, full-bank meta-skills improve macro-average performance by 8.95 percentage points over no-skill construction, and 12.02 points over direct delivery of the same bank to the Target.
Cheng Qian, Kun-Lun Zhu, Bei-Bin Li et al.· 0 citations
The method, Advisor Self-Distillation (AdviSD), pairs outcome-based reinforcement learning with self-distillation from a feedback-conditioned copy of the advisor selectively, and beats matched-count random selection, supporting the value of its selection rule.
Rishabh Agrawal, He-Jie Cui, Sha-Sha Li et al.· 0 citations
SelfSearch is introduced, a reward-free search procedure in which agents modify themselves using records of previous self-improvement episodes, providing concrete experience for improving both task solving and self-modification.
Certo is a small non-generative decision model (Qwen3-4B): it scores candidate actions from their text and returns a probability, instead of generating an answer, and how much rule-sensitivity survives that move, and whether it can be trained back.
D. Rajput, Nirdesh Chauhan, S.Rao Kosaraju· arXiv.org· 1 citation
Context Language Models are introduced, language models that natively manage their own context and can be steered with natural-language instructions evolved through a standard skill-optimization loop, improving held-out accuracy by up to 35.9 points on a context-management task while reducing compute.
Ru-Lin Shao, Shannon Zejiang Shen, J. Yin et al.· 4 citations
EngiWorld provides the first rigorous foundation for measuring progress toward agents that operate professional engineering software end to end, and introduces an artifact-centric evaluation methodology built on a unified domain-verifier suite.
Hong-Cheng Gao, Hai-Long Qu, Yu-Ang Lei et al.· 0 citations
KUPAS MASTER, an experience engineering platform built around nine-layer cognitive corpus construction, turns heterogeneous work records and practitioner interviews into traceable, reusable experience corpora for agents, and provides a practical path from individual tacit experience to organizational knowledge and agen...
Chang-Mian Wang, Yu-Chao Ma, Xu-Chao Lu et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.