Author

Sheng Shen

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Sep 2025

Positional Encoding via Token-Aware Phase Attention

Token-Aware Phase Attention (TAPA) is introduced, a new positional encoding method that incorporates a learnable phase function into the attention mechanism and attains substantially lower perplexity and stronger retrieval performance in the long-context regime than RoPE-style baselines.

Yu Wang, Sheng Shen, Rémi Munos et al. · arXiv.org · 2 citations