We present a theory for the optimal control of stochastic systems in structured environments, represented by penalty terms in the cost functional. We show that such control problems generically feature sharp finite-time transitions associated with a qualitative change in the control strategy at a critical time. Starting from an overdamped Langevin equation and a quadratic cost functional, we show that all resulting problems fall into three canonical equivalence classes (parabolic, hyperbolic, and elliptic), distinguished by the sign of the determinant of the control Hamiltonian. For each class, we obtain the optimal protocol, the cost function, and the critical time in closed form, and show that the transition exhibits features of a continuous phase transition at mean-field level. We then establish a mapping between the optimal control cost and the large-deviation rate function governing non-equilibrium relaxation after a potential quench. The mapping covers the parabolic and hyperbolic classes, while the elliptic class has no simple relaxation counterpart. This correspondence implies that recently discovered finite-time dynamical phase transitions, which are exponentially costly to sample directly, are accessible through ordinary averages over optimally controlled trajectories. To validate our theoretical findings, we report three experiments with optically trapped colloidal particles: a control transition for the mean stochastic work, and the finite-time dynamical phase transitions in free diffusion and in harmonic relaxation.
We study a class of linear-quadratic mean field games in which the state of each agent follows a stochastic Volterra equation of convolution type. The resulting dynamics are non-Markovian and account for memory effects through a completely monotone kernel, while the mean field interaction enters both the drift and diff...
We develop a stochastic mirror descent method for continuous-time McKean-Vlasov control with measure-valued controls and general Bregman regularisation. The dependence on the state law leads to a coupled Wasserstein-Bregman stability problem and to a McKean-Vlasov adjoint equation, which have no counterpart in classica...
We develop a quantitative framework for the long-time behavior of McKean--Vlasov stochastic differential equations with singular coefficients and possible phase transitions. The framework separates the existence of invariant measures from their uniqueness. For existence, we introduce a generalized Lyapunov condition wi...
These lecture notes present an introduction to large deviations in stochastic dynamical systems, adapted from a lecture series given at the Les Houches school ``Large Deviations: Theory and Applications''in July 2024. The exposition develops the theory through a unified methodology: WKB analysis of backward Kolmogorov...
L. Cirigliano, W. Piñeros, Anna Poggialini et al.· 0 citations
We study a conditional mean-field type linear quadratic optimal control problem for regime-switching diffusions with indefinite weights. The dynamics and cost depend on conditional expectations of the state and control given the history of the Markov chain. Under standard definiteness conditions, we establish the exist...
We investigate a class of backward stochastic differential equations (BSDEs) with at most quadratic growth which explode at a possibly unbounded random horizon, defined through the first hitting of zero of an adapted Ito process. In contrast with the classical theory of singular BSDEs, the explosion is generated by the...
Mathieu Lise, N. Touzi· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.