Author

Yupei Sui

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

Intrinsic Interaction Geometry Controls the Low-Rank Complexity of Softmax Attention

How much matrix rank is required to preserve every bounded value output of normalized softmax attention? We study the unrestricted maximum-row-\(\ell_1\) approximation rank \(r_\varepsilon(A)\), exactly the least rank achieving uniform error over all bounded vector-valued values. Row softmax exposes the intrinsic inter...

Yupei Sui, Jia-Ning Zhang, Ying-Zhi Tang · 1 citation

#artificial intelligence Preprint Aug 2026

The Approximation Rank of Softmax Attention: Sharp Geometric Laws and Robust Interaction Dimension

These results separate support geometry, which sets worst-case temperature scaling, from softmax-visible interaction geometry, which controls per-head approximation complexity, from softmax-visible interaction geometry, which controls per-head approximation complexity.

Yupei Sui, Jia-Ning Zhang · 0 citations