Book
Open access
Aug 2026
Fine-Grained Energy Accounting in Production LLM Serving
KV (Key-Value) volume is introduced, a physically grounded metric that captures the spatiotemporal footprint of a request’s KV cache occupancy, and it is shown that energy per KV volume (EPV) provides a stable and reproducible signature for modeling serving energy.
Xianyi Yuan, Hanlong Liao, Kunming Zhang et al.
· Asia-Pacific Workshop on Net... · 0 citations