Learning Agent Execution for KV-Cache Management in Agentic Serving
CacheScout is presented, an agent-aware KV-cache runtime layer for multi-agent LLM serving that improves KV-cache hit rate, reduces mean TTFT, lowers mean per-turn latency, and increases peak throughput by up to 57%.