Learning What to Ask and What to Believe: Distilling a Variational Bayesian Agent into Language Models
Interactive tasks such as eliciting a user's preferences or diagnosing a hidden mechanism require an agent to track its uncertainty over a latent state, ask informative questions and act on the answers. Language models have no explicit mechanism for this, whereas Bayesian information seeking provides one through poster...