Author

Miguel Couceiro

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

How Sparse Probability Maps Shape Mixture-of-Experts Routing

Mixture-of-experts (MoE) routers typically apply softmax to the router scores and keep the top-K experts, making every token use exactly K experts. Sparsity-inducing probability maps such as sparsemax, alpha-entmax and normmax can adaptively assign exact zeros to selected experts, and therefore appear to offer token-de...

Tomás Brogueira, Marcos V. Treviso, Miguel Couceiro · 0 citations

#machine learning May 2026

EntmaxKV: Support-Aware Decoding for Entmax Attention

EntmaxKV is introduced, an entmax-native sparse decoding framework that exploits sparsity before KV pages are loaded, and a Gaussian-aware entmax selector that estimates the entmax threshold from lightweight page statistics, adapting the selected budget to the score distribution.

Gonçalo Duarte, Miguel Couceiro, Marcos V. Treviso · arXiv.org · 0 citations