Memory-agent evaluations report fixed-snapshot accuracy or retrieval quality, but these scores do not show whether evidence remains usable as irrelevant sessions (sessions not annotated as task-relevant evidence for the query) accumulate. We present a scale-conditioned evaluation protocol for agent memory under evidenc...
Jiaqi Shao, Yiyi Lu, Yunzhen Zhang et al.· 0 citations
Reinforcement learning (RL) has substantially improved the ability of large language model (LLM) agents to interact with environments and solve multi-turn tasks. However, effective agentic RL remains challenging: sparse outcome-only rewards provide limited guidance for assigning credit to individual steps within long i...
Haotian Zhao, Songlin Zhou, Yuxin Zhang et al.· 0 citations
We demonstrate that a small transformer can learn to execute programs in MicroPy, a simplified yet computationally universal programming language. Given procedure definitions together with an expression to evaluate, the transformer predicts small-step execution using PENCIL scaffolding for space-efficient execution wit...
Ruize Xu, Chenxiao Yang, Yanhong Li et al.· 0 citations
Language Model (LM) agents are increasingly used in complex decision-making tasks, from AI coding to physical AI, where they must both explore a search space and exploit acquired knowledge effectively. Although exploration and exploitation play different roles in decision-making, it remains challenging to systematicall...
Jaden Park, Jungtaek Kim, Jongwon Jeong et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Understanding the landscape of artificial intelligence (AI) and machine learning (ML) adoption across the National Institutes of Health (NIH) portfolio is critical for research funding strategy, institutional planning, and health policy. The advent of large language models (LLMs) has fundamentally transformed research...
Automating optimization modeling with LLMs is a promising path toward scalable decision intelligence, but existing approaches either rely on agentic pipelines built on closed-source LLMs with high inference latency or fine-tune smaller LLMs using costly process supervision that often overfits to a single solver API. We...
Runda Guan, Xiangqing Shen, Jiajun Zhang et al.· 0 citations
Distributional metrics such as Fr\'echet Audio Distance cannot score individual music clips and correlate poorly with human judgments, while the only per-sample learned metric achieving high human correlation is closed-source. We introduce MUQ-EVAL, an open-source per-sample quality metric for AIgenerated music built b...
DEEPTHINK methods improve reasoning by generating, refining, and aggregating populations of candidate solutions, which enables strong performance on complex mathematical and scientific tasks. However, existing frameworks can still suffer from unreliable correctness signals during inference, which creates a population-...
Rituraj Sharma, Weiyuan Chen, Noah Provenzano et al.· 0 citations
Results show that principled decision-theoretic gating, paired with selective slow reasoning and aligned distillation, yields proactive agents that are precise, computationally efficient, and controllable.
ARC tasks can be formulated as visual transformation problems, where a model must infer a high-level transformation rule from a small set of demonstrations and apply it consistently across a grid. While dense Vision Transformers (ViTs) perform well in this setting, they entangle local visual state and global transforma...
Query correction is a critical entry point in modern search pipelines, demanding high accuracy strictly within real-time latency constraints. Chain-of-Thought (CoT) reasoning improves accuracy but incurs prohibitive latency for real-time query correction. A potential solution is to output an answer before reasoning to...
Chen Zhang, Kepu Zhang, Jiatong Zhang et al.· ACM International Conference...· 0 citations
The proposed Pharos-ESG is a unified framework that transforms ESG reports into structured representations through multimodal parsing, contextual narration, and hierarchical labeling, and enriches its outputs with ESG, GRI, and sentiment labels, yielding annotations aligned with the analytical demands of financial rese...
Yan Chen, Yu Zou, Ji Zeng et al.· arXiv.org· 1 citation