Exact Distinguishability in Non-Markovian Decision Processes
Non-Markovian environments are often modeled as Regular Decision Processes (RDPs), where dynamics depend on the interaction history through a finite automaton. Existing offline guarantees for RDPs rely on a distinguishability assumption on the behaviour policy but provide no means of verifying it. When the assumption i...
Kabir Murjani, Nisarg Patel
· 0 citations