SCOPE reframes objective design as a mechanism for guiding policy exploration, enabling the search process to exploit observed evidence while maintaining structured diversity across discrete solution spaces and generalizes well across diverse combinatorial structures.
Abstract
Black-box combinatorial optimization requires systematically identifying high-quality solutions under a limited evaluation budget, yet the unknown objective function provides little guidance for deciding where the search should explore next. We introduce SCOPE, a general framework for Synthetic Conditional Objectives for Policy Evolution in Black-Box Combinatorial Optimization. Rather than directly optimizing the inaccessible objective, SCOPE learns a set of synthetic objectives conditioned on the accumulated search history, where each objective is designed to expose a distinct and potentially useful preference over candidate solutions. These objectives are then used to evolve search policies that generate diverse candidates, whose true quality is subsequently assessed through black-box evaluations. The outer loop adaptively updates and selects synthetic objectives according to how effectively their induced policies discover promising regions. In contrast, the inner loop returns a portfolio of top-performing policies to reduce the risk of relying on a single surrogate preference. This formulation reframes objective design as a mechanism for guiding policy exploration, enabling the search process to exploit observed evidence while maintaining structured diversity across discrete solution spaces. Extensive experiments across multiple benchmark problems demonstrate that SCOPE consistently improves black-box search performance under limited evaluation budgets and generalizes well across diverse combinatorial structures.
Multi-Objective Agent Evolution (MOAE) is introduced, which organizes iterative in-context refinement as a Pareto-preserving evolutionary search over complete agent rollouts and consistently improves task performance and trajectory quality while maintaining strong safety under matched rollout budgets.
Heng-Le Jiang, Qi-Jun Cai, Zi-Ying Luo et al.· 0 citations
These results support accounting for selection history when constructing and evaluating search-agent rollouts and rank first on seven QA benchmarks using Qwen3-4B, Qwen3-8B, and Qwen2.5-7B.
Zeng-Huang Fu, Ning Chen, Ming-Da Jia et al.· 0 citations
This work introduces ExTS, a tree-search policy that treats expansion itself as a value-of-information decision, and introduces pilot-run diagnostics that characterize what makes budget-constrained agentic search problems structurally different from one another, providing both understanding of the problem space and pra...
Reinforcement learning over a frozen reasoner has become a common recipe for teaching a policy which external tools to invoke. We show that this recipe becomes structurally mismatched in specialist scientific settings where the complete tool-subset space is enumerable. There, a small set of recurring computational capa...
Hao-Yue Liu, Xiao-Yu Ma, Ye-Heng Chen et al.· 0 citations
LOGIC transforms the exploration paradigm: instead of exploring at the action level, it employs an integrated critic to guide a generator in discovering optimal, high-value goals (RTGs), enabling robust exploration beyond the dataset's frontier while avoiding the fragility of complex multi-loss objectives.
Shi-Hao Shu, Rujie Zhong, Hao Wang et al.· Proceedings of the 32nd ACM...· 0 citations
This work introduces Open-Ended Optimization (OEO), which keeps the objective, permitted interactions, resource budget, data boundary, and evaluation fixed while allowing the optimizer to compose the improvement process online.
Xue Hui, Fan Yang· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.