Author

A. Zeris

h-index 2 View on Semantic Scholar

We have 1 of 9 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Jul 2026

FourierQK: Spectral Preprocessing of Query-Key Projections Improves Transformer Attention

FFT-based spectral preprocessing of learned query-key (Q/K) projections substantially improves transformer attention on character-level language modelling and defines an architectural boundary between bilateral spectral attention and genuinely causal spectral attention at word-scale tokenisation.

A. Zeris · arXiv.org · 0 citations