Jul 2026
Cache-Aware Prompt Compression:A Two-Tier Cost Model for LLM API Caching
This work proposes Cache-Aware Prompt Compression (CAPC), pairing query-agnostic compression with explicit cache_control plus a tier-preserving ratio bound that prevents over-compression from pushing the cached prefix into the hot tier.
Yangfan Song
· arXiv.org · 1 citation