Future Information-Directed Sampling for Bayesian Nonstationary Bandits
This paper proposes Future Information-Directed Sampling (FIDS), a new algorithm for Bayesian nonstationary bandits that explicitly explores to gather information about future optimal arms and shows that FIDS achieves regret comparable to Thompson Sampling up to a small constant factor.