R. Srikant

Rates of Convergence in the Central Limit Theorem for Markov Chains, with an Application to TD Learning

A nonasymptotic central limit theorem (CLT) for vector-valued martingale differences is proved using Stein’s method and Poisson’s equation is extended to extend the result to functions of Markov chains.