This analysis provides convergence guarantees directly for the computable particle system, complementing recent continuous-time and mean-field results in infinite dimensions and establishing quantitative pairwise contraction, exponential decay of the expected swarm variance, and almost-sure convergence of all particles to a common consensus state.
Abstract
We study a time-discrete, finite-particle Consensus-Based Optimization (CBO) algorithm in a separable Hilbert space. Our analysis provides convergence guarantees directly for the computable particle system, complementing recent continuous-time and mean-field results in infinite dimensions. Using a common-noise formulation with trace-class covariance, we first establish quantitative pairwise contraction, exponential decay of the expected swarm variance, and almost-sure convergence of all particles to a common consensus state. We then combine estimates on the exponentiated objective functional with a quantitative Laplace principle to show that, for sufficiently large inverse temperature and suitably prepared initial data, the energy of the limiting consensus state can be made arbitrarily close to the global minimum over the active subspace. A key feature of the Hilbert-space formulation is that the stochastic contribution to the convergence estimates is controlled by the trace of the covariance operator and is therefore uniform with respect to the Galerkin dimension. Numerical experiments on an elliptic energy minimization problem with mixed boundary conditions and a PDE-constrained inverse source problem validate the theoretical convergence results and demonstrate stable performance under increasing spatial resolution, in contrast with CBO based on isotropic finite-dimensional noise.
We establish quantitative convergence to the target and uniform-in-time propagation of chaos for Langevin-regularized Stein variational gradient descent. The Stein interaction need not be small relative to the confining Langevin drift and does not generally yield a contractive particle coupling. At the mean-field level...
This work introduces SCMO (Stochastic Control Measure Optimizer), a gradient-free particle method derived from entropy regularized stochastic control, and proves finite-candidate consistency and shows that the signed, curvature-dependent effect of nonmatched covariance can reduce the resulting upper bound on the approx...
Affine-invariant ensemble samplers are widely used in Bayesian applications. However, their quantitative convergence theory, in particular geometric ergodicity, remains a basic open question. We study the affine invariant ensemble Langevin dynamics, an interacting particle system that uses the empirical covariance of t...
We study finite-time concentration and convergence rates for projected two-time-scale stochastic approximation driven by a controlled Markov chain. The averaged fast map is contractive, while the slow iterate is projected onto a compact convex polyhedron. The associated projected ordinary differential equation may have...
Rahul Singh, Vivek S. Borkar, E. Moulines· 0 citations
We prove uniform-in-time propagation of chaos and last-iterate consistency for a target-adapted Stein variational gradient descent (SVGD) flow on compact connected manifolds. The target has a smooth positive density, and the particles start independently from a fixed smooth nonnegative density ratio. The construction u...
A general class of non-reversible Hamiltonian Monte Carlo dynamics on discrete state spaces is developed, revealing a diffusive-to-ballistic speed-up over reversible samplers, even for heterogeneous target distributions where standard non-reversible methods become diffusive.