Author

Wen-Qian Weng

h-index 3 View on Semantic Scholar

We have 1 of 7 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Feb 2026

ActTail: Global Activation Sparsity in Large Language Models

ActTail is proposed, a TopK magnitude-based activation sparsity method with global activation sparsity allocation grounded in Heavy-Tailed Self-Regularization (HT-SR) theory that improves both perplexity and downstream task performance at high sparsity compared to uniform allocation.

Wen-Wen Hou, Xin-Yuan Song, Wen-Qian Weng et al. · arXiv.org · 2 citations