Jul 2026
A Coulomb Particle Model for Learning Kernel Attention in Transformers
A particle-based method that learns this distribution by optimizing kernel-target alignment while regularizing particles with a Riesz/Coulomb repulsive potential is proposed and instantiate the method in linearized Transformer attention.
M. B. Khuzani, Sharath Honnaiah, Atiq Islam et al.
· arXiv.org · 0 citations