It is found that model pairs can learn to communicate the secret using only one bit of feedback indicating whether the receiver inferred it correctly, during inference with fixed parameters and no supplied codebook or encoding examples.
Jacob Dineen, Si-Lei Ren, Mu-Hao Chen et al.· 2 citations
BOW is introduced, an RL framework that instead trains models to produce self-contained, neutral, and comprehensive descriptions of the plausible next-word space, and human evaluation shows that BOW-Reg produces broader next-word reasoning trajectories, while direct next-word-prediction evaluation shows that these traj...
This work proves a PAC-Bayes bound guaranteeing that a dictionary extracted from successful trajectories has bounded expected description length on future successful behavior, and introduces ReuseRL, which grounds agentic RL in the Minimum Description Length (MDL) principle.
Zhikun Xu, Yu Feng, Jacob Dineen et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.