LLM agents increasingly operate over sensitive resources, such as private documents and mutable system states, which can create serious safety and security risks. Runtime guardrails should therefore make inspectable, reproducible, and deterministic allow or refuse decisions before potentially irreversible agent actions...
Duy Nguyen, Lesly Miculicich, Bhavana Dalvi et al.· 0 citations
LLM agents retrieve untrusted content and act through tools, creating indirect prompt-injection risks that can cause unauthorized actions or persistent state changes. Existing automated red-teaming largely optimizes payloads for pre-specified scenarios, leaving latent vulnerabilities across the agent's behavior space u...
Peng-Fei He, Deepanjan Mitra, Vishesh Sharma et al.· 0 citations
Regularized Recursive Self-Improvement of Agent Harnesses (RRSI) is introduced, which incorporates the principles of regularizations into harness self-improvement by constraining the evolution candidate proposal and selection.
Peng Xia, Ru-Jun Han, Zifeng Wang et al.· 11 citations· ⚡3
As LLM agents undertake increasingly complex, long-horizon tasks, verifying their outputs becomes increasingly challenging. We study how verification capability can be strengthened with a fixed base model, without access to reference answers or grading rubrics at test time. Repeated sampling yields multiple rollouts th...
Caiqi Zhang, Ru-Jun Han, Zifeng Wang et al.· 0 citations
An LLM agent's capability is largely magnified by its harness, namely the prompts, control flow, tooling, memory, and context management surrounding the frozen backbone model. Recent methods increasingly automate this process by iteratively proposing and selecting component-wise edits of an agent harness, practically e...
Peng Xia, Ru-Jun Han, Zifeng Wang et al.· 3 citations· ⚡1
FinanceHarness is presented, a harness that runs finance-oriented tools and practitioner-guided workflows, automating financial deep research end to end: environment and data construction, the agent execution loop, and reward modeling, and FinanceGym, comprising thesis-driven research questions and rubrics that combine...
Environment Harness is proposed, a programmable layer of plug-in components that wraps a static environment to reshape its behavior without modifying the underlying logic, enabling continuous, targeted co-evolution of the policy and its environment.
Chengsong Huang, Zifeng Wang, Ru-Jun Han et al.· 15 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.