Author

Yikuan Xia

h-index 5 View on Semantic Scholar

We have 1 of 14 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence May 2026

More Expressive Feedforward Layers: Part I. Token-Adaptive Mixing of Activations

This work proposes Mixture of Activations (MoA), a token-adaptive FFN design that mixes a dictionary of activation functions using lightweight input-dependent gates while sharing the same linear projections, suggesting that token-adaptive activation mixing is a simple and effective mechanism for improving FFN expressiv...

Mingze Wang, Jinbo Wang, Yikuan Xia et al. · arXiv.org · 3 citations