Author

Akshan Agrawal

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

Lightweight Scheduling Policies for Continuously Batched LLM Serving Across GPU Architectures

Large language model serving is increasingly limited not only by model size and GPU speed, but also by scheduling during autoregressive decoding, where continuous batching interleaves requests at token granularity as sequences arrive and finish. We study whether lightweight scheduling policies can improve latency-throu...

Ashman Mehra, Akshan Agrawal, Aryeh Carmi · 0 citations