LiveMACEBench is introduced, a process-aware benchmark that uses live financial markets as a naturally evolving testbed for persistent LLM agents, demonstrating that mechanism access, effective mechanism use, and downstream performance are not interchangeable measures of agent capability.
Jun Zhao, Lei-Ming Fu, Yan Wen et al.· 0 citations
Bozano is described, a multi-agent open-source system that uses parallel prover agents with a verifier agent and maintains a human-readable research state that solves open problems and answers four questions raised in the papers.
Adrián Zámecník, Matej Kripner, Martin Koutecký et al.· 0 citations
Real-world documents distribute evidence across text, tables, figures, and captions within complex page layouts. Answering complex questions over such documents therefore requires more than retrieving relevant passages: systems must recover the evidence topology that connects heterogeneous evidence units. Existing Grap...
Ruo-Chi Li, Jian-Zhe Lin, Haoxuan Zhang et al.· 0 citations
Scientific studies of language agents need behavioral variables that support hypotheses across tasks and models. We formulate this research problem as learning and testing a hierarchy of trajectory abstractions. A concrete recursive procedure first measures role- and phase-indexed events, proposes temporally constraine...
Tian-Qiang Yan· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Extreme low-bit LLM compression is most challenging when weights, activations, and KV caches are quantized together: their distributions differ, and quantization errors interact throughout the network. We introduce CanonQ, a unified quantization-aware training framework that addresses these challenges by separating sou...
Kai Yi, Tarek Elgamal, Sruthikesh Surineni et al.· 0 citations
MemoryAgentBench's Conflict Resolution split is read as measuring "selective forgetting". We execute the benchmark's own rule - the newest statement about a fact wins - as a zero-learning resolver frozen on one of the four fact lists. Under the official metric the rule answers 80.25% of the questions (74.5% on the thre...
Steering an LLM agent means deciding whether to correct it, at which step, and with which mechanism. Uncertainty is often used to decide when to correct an agent, but whether it can guide these decisions remains unclear. We steer agent trajectories separately at every non-terminal step with each of four mechanisms and...
Han Li, Jinhao Duan, Guan-Hua Zhu et al.· 0 citations
This work introduces TRACE, an algorithm that organizes candidate constraints in a tree and tests each proposed refinement by generating actions that satisfy it, and evaluates TRACE across six language-feedback tasks, showing greater robustness than direct accumulation when the falsification detector remains reliable.
Shao-Ang Li, Daniel R. Jiang, Jian Li· 0 citations
We present BEACON-SP, an ontology-grounded Graph Retrieval-Augmented Generation (GraphRAG) framework for clinician-facing decision support in behavioral health settings such as suicide prevention, where effective assessment requires integrating heterogeneous clinical, behavioral, social, and temporal evidence. BEACON-S...
Kemal Davaslioglu, Nathan Conger, Sastry Kompella et al.· 0 citations
As small language models (SLMs) are increasingly deployed on resource-constrained and on-device platforms, including as components of agentic systems, the integrity of locally stored model parameters becomes an important safety concern. We investigate whether safety-sensitive behavior in LLaMA-2-7B-Chat is concentrated...
This work introduces Route-Verify-Vote (RVV), a framework for procedure-conditioned self-consistency that uses language models without parameter updates that supports domain-specific reasoning procedures and answer-set disagreement as useful tools for allocating inference-time computation in mixed-domain reasoning.
Recent advances in truncation-based sampling have helped mitigate drawbacks of high-temperature sampling such as neural text degeneration, thereby enabling greater diversity without sacrificing coherence. However, increasing the entropy of the token probability distribution via high temperatures has also been shown to...
Phillip Howard, Xin Su, Allen Roush et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.