Language Models Can Control Their Own Attention
Declarative Attention is introduced, a protocol that elicits the model to declare where it needs to attend within its chain-of-thought, partitioning generation into three modes:(full context),(a specific region), and(recent output only).
Namgyu Ho, Huzama Ahmad, Woosung Koh et al.
· 1 citation