Jin Li

Shrinking-Tube Concentration for Adaptive Markovian Stochastic Approximation

Adaptive algorithms increasingly make decisions while reshaping the dynamics that generate their future data. We establish a shrinking-tube concentration bound for projected stochastic approximation driven by an adaptive Markov chain. The bound guarantees, with high probability, that every iterate after a chosen time r...