Closing the Log Gap: Minimax-Optimal Regret for Episodic RL
This paper introduces a variant of UCBVI which does not maintain strictly optimistic estimates, and uses MOSS-style exploration bonuses whose logarithmic terms adapt to both visit counts and estimated variances, and develops time-uniform and variance-aware concentration bounds that may be of independent interest.