Ask Self, Ask Others: Relation Is All You Need
Attention dominates token mixing, but it collapses relation formation and flow allocation into a single score-to-flow step. We introduce Relation, which separates them by first organizing pairwise evidence into explicit Self and Exchange relations and deriving information flow afterward. Relation first decides whether...
Yuting Ge, Peng Yang, Mingkai Nie
· 0 citations