Beyond Static and Linear: What Attention Constraints Best Fit Human Reading Times?
A systematic comparison of multiple attention-based memory mechanisms across different model sizes and training corpora finds that constraints that are sensitive to the content of intervening tokens consistently achieve the highest alignment with human reading times, outperforming distance-based constraints.