Entropy-Guided LLM Decoding via Probabilistic Circuits
Zhizhen Chen, Daniel Mingyi Israel, Guy Van den Broeck et al.
· 0 citations
Sponsored
AI Networking Cookbook: Practical recipes for AI-assisted network automation and development
AI Networking Cookbook: Practical recipes for AI-assisted network automation and development
2 papers indexed here
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
A Probabilistic Interpretation of KV Cache Eviction
This paper formalizes the problem of KV eviction and proves that it is computationally hard, and shows that this probabilistic version of KV eviction coupled with decode time correction is more robust to different tasks compared to existing eviction methods and achieves competitive performance at the same compression budget.
Renato Lui Geh, Alexander K. Chen, Daniel Mingyi Israel et al.
· 0 citations