Skip to content

Author

Gonçalo Duarte

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

EntmaxKV: Support-Aware Decoding for Entmax Attention

EntmaxKV is introduced, an entmax-native sparse decoding framework that exploits sparsity before KV pages are loaded, and a Gaussian-aware entmax selector that estimates the entmax threshold from lightweight page statistics, adapting the selected budget to the score distribution.

Gonçalo Duarte, Miguel Couceiro, Marcos V. Treviso · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.