#machine learning
May 2026
A Finite-Iteration Theory for Asynchronous Categorical Distributional Temporal-Difference Learning
Finite-iteration behavior of the exact asynchronous recursions used by categorical distributional temporal-difference methods is studied and analogous finite-iteration guarantees for horizon-stacked categorical methods under episodic sampling are established.
Ege C. Kaya, Abolfazl Hashemi
· arXiv.org · 2 citations