Skip to content
Conference Open access

A Sampling-Based Relaxation Approach to Contextual Inverse Optimization

Sep 2026 · Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence · 0 citations · 44 references

TL;DR

A learning algorithm for general optimization problems with linear objective functions that eliminates the need to solve inverse optimization problems, and achieves competitive performance in terms of regret compared with existing methods, while offering improved computational efficiency for certain classes of downstream optimization problems.

Abstract

Decision-making pipelines increasingly rely on prediction models whose outputs serve as inputs to downstream optimization problems. Decision-Focused Learning (DFL) has emerged as a promising approach to training such models by directly optimizing decision quality rather than predictive accuracy alone. While most existing DFL methods assume a complete-information setting in which the ground-truth optimization parameters are observed, this paper studies Contextual Inverse Optimization (CIO), an incomplete-information setting in which only the resulting solutions are observed. Prior work on CIO has proposed learning algorithms based on optimality conditions for linear programs, as well as methods that repeatedly solve inverse optimization problems to handle integer programs, often incurring a substantial computational burden. In this paper, we propose a learning algorithm for general optimization problems with linear objective functions that eliminates the need to solve inverse optimization problems. The proposed method learns prediction models by solving a Relaxed Inverse Optimization Problem (RIOP), constructed based on feasible solutions randomly sampled from the feasible region, thereby reducing the computational overhead associated with existing CIO methods. Numerical experiments demonstrate that our method achieves competitive performance in terms of regret compared with existing methods, while offering improved computational efficiency for certain classes of downstream optimization problems.

Read PDF

Similar papers

Preprint Aug 2026

Integrated Learning and Robust Optimization

This work proposes an integrated learning and robust optimization (ILRO) framework, where a robust decision problem is used both to define the training problem (termed the RSPO loss problem), and to produce the deployed decision, which achieves both robustness and learning-decision alignment.

Chengpeng Tan, Yu-Chen Mao, Shu-Ming Wang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

TACIT: Optimization Models that Learn from Their Mistakes

Real-world optimization problems are difficult to model accurately because many objectives and constraints reside in domain experts'tacit knowledge, making them hard to formalize. As a result, optimization models often contain miscalibrated objectives, missing constraints, or omitted decision variables, leading to solu...

Maxime Bouscary, Marco Molinaro, Si-Rui Li et al. · 0 citations
#machine learning Preprint Sep 2026

Bayesian Optimization with Rich Auxiliary Information via LLMs

Two methods are introduced, AuxBO-Evolve, which uses auxiliary information to evolve beliefs over the location of the optimum, and AuxBO-Vicinity, which uses it to locally guide the acquisition function, which consistently improve optimization performance and outperform standard BO and existing LLM-based approaches.

Efe Mert Karagözlü, Rohit Sonker, Tejus Gupta et al. · 0 citations
#machine learning Preprint Sep 2026

Learning to Optimize through Solver-Grounded Self-Play

Results indicate that with zero curated data, OPT-Zero matches state-of-the-art data-dependent methods while exhibiting substantially stronger generalizability, establishing self-play training as a highly scalable paradigm for advancing LLM reasoning in modeling and solving optimization problems.

Xia Jiang, Yao-Xin Wu, Chen-Yu Zhou et al. · 0 citations
Open access Aug 2026

Decision-Driven Regularization: A Blended Model for Learning and Optimization

This paper proposes a biobjective formulation that balances prediction accuracy and cost minimization, termed decision-driven regularization, which is shown to be numerically superior to other benchmarks, such as ordinary least squares, random forest, XGBoost, SPO+, perturbation gradient, and learning and rank, in the...

G. Loke, Qin-Shen Tang, Yangge Xiao et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.