AI Networking Cookbook: Practical recipes for AI-assisted network automation and development
Category
9,568 papers
A three-stage symbolic reasoning circuit (abstraction, induction, retrieval) is traced across shot counts in three model families and finds it is detectable and functional well before the model achieves high accuracy.
This work introduces Population Fidelity, an evaluation framework that distinguishes key conditions required for a set of LLM-generated responses to represent a population and organizes these features and provides reusable code, data, and trained models for evaluating population fidelity across substantive domains and...
Large language models are increasingly evaluated in specialized domains such as law, medicine, software engineering, and cybersecurity, yet film remains comparatively underexplored despite requiring long-form narrative integration, multilingual interpretation, and culturally situated audience judgments. We introduce Ci...
A preliminary extension to coding tasks shows that SCOUT can support safety verification beyond computer-use, andlations and analysis show that tool-free rubric generation in SCOUT elicits substantially more reasoning and is crucial for safety detection across verifier backbones, especially non-frontier ones.
Reach audiences
Advertise in front of researchers, engineers, and readers.
ProVer, a framework that targets potentially pivotal decisions for fine-grained credit assignment in agentic reinforcement learning, is introduced, highlighting the effectiveness and efficiency of selectively targeting pivotal decisions for fine-grained credit assignment in agentic reinforcement learning.
The results suggest that LLMs tend to present narratives of success by default, and that steering models toward honesty makes their reports substantially more transparent.
Language models are frequently employed to evaluate other language models. An LM evaluator scoring agentic behaviors across multiple criteria is valuable, provided that its decisions align with human judgment. We call the problem of evaluating this alignment Meta-Evaluation. Tackling it directly is difficult: collectin...
It is argued that the work of memory divides, as thinking does, into two systems: long-term memory and reasoning model answering, and Mnemon, a memory agent built on this division.
This work studies activations from ensembles of prompts that require inferring relationships between three tokens corresponding to a cyclic concept to correctly predict the next token and finds a consistent layerwise progression in how the joint dependence among the tokens is geometrically organized and causally used.
VoxParity tests whether agents act on how a caller sounds, or how a caller sounds, or what else is audible, can change the right action and whether agents act on it.
CruxBench is introduced, a benchmark that grades LLM-generated questions by their Value of Information (VOI): how much a model-proposed crux updates beliefs about a target forecasting question and finds that VOI correlates highly with independent measures of model capability and captures cruxes'usefulness for answering...
PACT is proposed, which turns this structure into four training terms that need no new annotation: a difference-in-differences margin over each pair that is invariant to any shared logit offset, a permutation-consistency term against answer-code position bias, an evidence-necessity term on certificate-verified ablated...
Natural Language Processing
Our most capable vision-language-action model enhances robot dexterity, reliability, and safety
A Blog post by Ai2 on Hugging Face
A Blog post by IBM Research on Hugging Face
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
