Evaluation has been central to advances in AI, and it is equally critical to autonomous discovery. Yet scaling autonomous discovery to real-world engineering challenges faces a fundamental bottleneck: the cost of evaluating progress. In real settings, a single true evaluation, such as a full benchmark or serving trace,...
Shubham Agarwal, Akshat Gupta, M. Heddes et al.· 0 citations
Regularized Recursive Self-Improvement of Agent Harnesses (RRSI) is introduced, which incorporates the principles of regularizations into harness self-improvement by constraining the evolution candidate proposal and selection.
Peng Xia, Ru-Jun Han, Zifeng Wang et al.· 11 citations· ⚡3
An LLM agent's capability is largely magnified by its harness, namely the prompts, control flow, tooling, memory, and context management surrounding the frozen backbone model. Recent methods increasingly automate this process by iteratively proposing and selecting component-wise edits of an agent harness, practically e...
Peng Xia, Ru-Jun Han, Zifeng Wang et al.· 3 citations· ⚡1
FinanceHarness is presented, a harness that runs finance-oriented tools and practitioner-guided workflows, automating financial deep research end to end: environment and data construction, the agent execution loop, and reward modeling, and FinanceGym, comprising thesis-driven research questions and rubrics that combine...
Environment Harness is proposed, a programmable layer of plug-in components that wraps a static environment to reshape its behavior without modifying the underlying logic, enabling continuous, targeted co-evolution of the policy and its environment.
Chengsong Huang, Zifeng Wang, Ru-Jun Han et al.· 15 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.