Deep Epistemic Value Functions for Optimistic Exploration
A systematic empirical study of how epistemic uncertainty is represented, propagated, and optimized in deep epistemic value functions, and uncover distinct failure modes along each of these axes provides evidence that deep epistemic value functions are a promising path toward scalable, principled exploration.