Li-Zi Liao

Learning to Accumulate Knowledge with Mutual Information

Reinforcement learning framework Knowledge Weaver is proposed, a reinforcement learning framework that trains a language model to curate reusable knowledge from agent trajectories and couple feedback inspired by token-wise mutual information with marginal success rewards to guide knowledge accumulation.