Reinforcement learning (RL) has emerged as a key paradigm for improving large language model (LLM) agents, enabling stronger reasoning, planning, and tool-use in interactive environments. However, existing agent RL methods remain fundamentally constrained by an on-policy reasoning bottleneck: when tasks exceed the mode...
Xi Chen, Rui-Xue Ding, Zhigaoyuan Wang et al.· 0 citations
2FFS is proposed, a two-fidelity tree-search algorithm that brings multi-fidelity flat bandit ideas into trees and proves fixed-confidence correctness, establish finite stopping for exact identification, and give a polynomial-depth cost upper bound for general-depth trees.
Search agents are usually trained under a single harness. But once an agent is deployed in a real application, its harness is frequently updated (e.g., a rewritten system prompt) to fit production needs. This exposes a fragility of post-trained agents: because a learned behavior is entangled with its training harness,...
Xin-Lu Zhang, Ying-Chun Lin, Zhi-Han Zhang et al.· 0 citations
This work proposes ArenaFlow, a hierarchical credit propagation framework for open-ended agent reinforcement learning that leverages tournament-based relative ranking to derive trajectory-level reward signals and propagates trajectory-level advantages to high-confidence pivotal steps according to tournament survival de...
Qiang Zhang, Rui-Xue Ding, Fan-Rui Zhang et al.· 1 citation
This paper proposes and analyzes Comparison-based Preference Optimization (ComPO), a zeroth-order alignment method based on comparison oracles, and establishes a convergence guarantee for its basic offline scheme under smoothness, gradient sparsity, and compatibility between the oracle and a latent objective.
Peter Chen, Xi Chen, Wo-Tao Yin et al.· 0 citations
ARISE-RL, a novel full-cycle self-evolution framework that couples a task/rubric Generator and a reasoning Solver through rubric-mediated co-evolution, is proposed and ECR-Bench, an expert-calibrated rubric benchmark suite covering single-tool deep research and multi-tool travel planning is presented.
Fan-Rui Zhang, Rui-Xue Ding, Qiang Zhang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.