Skip to content

Author

Jiakun Fan

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Rethinking KV Cache Eviction for Agentic LLM Serving

Key-value (KV) caches impose substantial memory pressure on large language model serving systems, requiring cache eviction when capacity is insufficient. Existing mechanisms typically evict KV from the ends of cached sequences to preserve prefix sharing across requests. However, agent workloads repeatedly reuse long hi...

Jia-Kun Fan, Han Meng, Yu-Xin Xia et al. · 0 citations
Book Open access Jul 2026

dLLM-Serve: Bridging the Memory Gap in Diffusion Language Model Serving

Diffusion Large Language Models (dLLMs) have emerged as a promising alternative to Autoregressive Models (ARMs), utilizing parallel decoding to overcome sequential bottlenecks. However, existing research focuses primarily on kernel-level optimizations, lacking a holistic serving framework that addresses the unique memo...

Jiakun Fan, Yang-Lin Zhang, Xiangchen Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.