Skip to content

Author

Abhay Kumar

We have 2 of 6 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

Grouped Value Attention: Efficient KV Caching via On-Demand Key Reconstruction

This work introduces Grouped Value Attention (GVA), which stores grouped values and reconstructs content keys with a learned linear map at inference, which can be absorbed into the query, eliminating the need to materialize content keys in the intended decode path.

Vishesh Tripathi, Abhay Kumar, Ramsha Khan · 0 citations
Preprint Jul 2026

Train Smarter, Not Longer: Memorization-Guided Data Reuse for Efficient LLM Training

This work proposes "Memorization-guided Data Reuse", a training paradigm that adaptively determines when and how data should be reused, enabling principled decisions on the number of training epochs and the scheduling of data replays.

Jingwei Zuo, Cong Zeng, Ilyas Chahed et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.