Silent and Costly: Characterizing and Detecting Prompt-Caching Mis-Integration in LLM Agents
CACHELINT is designed, which models a prompt-caching mis-integration as an invocation site together with the preconditions required for correct cache integration, and locates caching invocation sites with CodeQL and discharges each precondition either against a dated provider capability oracle or with an LLM guard chec...
Ying Zhang, Ruo-Qi Guo, Yi Liu et al.
· 0 citations