Skip to content

Author

Korbinian Pöppel

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Review

Challenging Quadratic Attention - A Holistic View On the Rise of Alternative Language Model Architectures

This work critically analyze approaches regarding compute and memory complexity, benchmark results, and fundamental limitations to assess whether the dominance of pure-attention transformers may soon be challenged, which it considers possible, particularly in domain-specific and edge-device applications.

Alexander M. Fichtl, Jeremias Bohn, Josefin Kelber et al. · 0 citations
#machine learning Preprint Sep 2026

Complex KDA: Understanding and Enhancing the Expressivity of Kimi Delta Attention

This work shows that Kimi Delta Attention (KDA) can realize 2D rotations by combining a single delta-rule transformation with a second reflection supplied by its channel-wise gate, and characterize the expressivity of CKDA and prove that every orthogonal diagonal-plus-rank-one matrix is exactly a CKDA transition matrix...

Julien Siems, Riccardo Grazzi, Korbinian Pöppel et al. · 1 citation · ⚡1

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.