Skip to content
Preprint

Perturbed utility Markovian traffic equilibrium: theory and computation

Jul 2026 · 0 citations · 67 references
Mathematics Economics

TL;DR

A perturbed utility Markovian equilibrium (PUME) framework that preserves the scalability of link-based Markovian traffic equilibrium models and extends their applicability to settings with boundary choice probabilities, undiscounted network loading, and general link interactions.

Abstract

Large-scale traffic assignment requires equilibrium models that are both behaviorally plausible and computationally tractable. This paper develops a perturbed utility Markovian equilibrium (PUME) framework that preserves the scalability of link-based Markovian traffic equilibrium models and extends their applicability to settings with boundary choice probabilities, undiscounted network loading, and general link interactions. As the behavioral basis of PUME, we first develop the perturbed utility Markovian choice model (PUMCM) in which the Bellman optimality operator is defined through a convex surplus function whose gradient directly yields the optimal policy. The model generalizes existing additive random utility (ARUM) Markovian choice models and admits both interior and boundary choice probabilities. Accordingly, unattractive links can receive zero flow without imposing ex ante choice-set restrictions as in existing ARUM models. We establish conditions under which the corresponding Markov decision problem is well posed and yields a proper demand mapping. We then formulate the equilibrium as a variational inequality (VI) problem on the dual cost space and establish its existence and uniqueness. Particularly, the VI formulation of PUME accommodates non-separable and asymmetric cost structures and thus offers a more flexible modeling framework than existing Markovian traffic equilibrium (MTE) models. For computation, we develop a modified policy iteration method for network loading and a safeguarded accelerated meta-algorithm for computing equilibrium. Both algorithms are proven to be globally convergent and have demonstrated satisfactory numerical performances. Experiments on benchmark and synthetic networks further show that the proposed framework is highly scalable and robust towards a wide variety of demand-supply settings.

View source

Similar papers

Preprint Aug 2026

Equilibrium in Multi-Agent Reinforcement Learning

Standard solution concepts for stochastic games, such as Markov perfect equilibrium and Markov coarse correlated equilibrium, are computationally difficult, and thus, standard decentralized reinforcement-learning algorithms should not generally be expected to converge to them. In this paper, we study the equilibrium ge...

Maurizio D'Andrea, Bar Light · 0 citations
Preprint Aug 2026

Tolls for Dynamic Equilibrium Flows

A duality-based characterization of implementability of dynamic edge flows for the multi-source, multi-destination case and a non-trivial proof that this assumption is always fulfilled for finitely supported edge flows with costs representing weighted travel times are provided.

Lukas Graf, Tobias Harks, Julian Schwarz · 0 citations
Preprint Jul 2026

A Principal-Agent Mean-Field Game Model of Insurance with Risk Interdependence

We study an insurance contract-design problem under moral hazard, endogenous participation, and strategic risk interdependence. Because the resulting $N$-agent game suffers from the curse of dimensionality, we approximate the strategic interactions via a heterogeneous mean-field game. We rigorously establish the existe...

Asaf Cohen, Ruolan He, Ming-Yan Liu · 0 citations
Preprint Aug 2026

Computing Equilibria in Simulation-Based Insurance Markets with Discontinuous Demand

We study equilibrium computation in simulation-based games motivated by competition in natural-hazard insurance markets. The motivating application considers a multi-region market in which each insurer selects regional pricing and reinsurance decisions to maximize expected financial performance subject to multi-period...

Yunsoo Ha, Linda Nozick · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.