Recurrent Memory as State Abstraction Over History
This work considers agent memory as a temporally-extended abstraction over the agent’s observation-action history, and derives POMDP classes by applying traditional MDP state abstractions, such as model-preservation, optimal value Q ∗ preservation, and optimal policy π ∗ preservation, to the POMDP setting.