Accelerating Graph-Based RAG Retrieval via Locality-Aware Device-Cloud Collaboration
This paper proposes Lever, a locality-aware collaborative retrieval framework that exploits query locality to accelerate graph-based RAG retrieval, and identifies and empirically validate a previously underexplored property of RAG workloads: strong per-user query locality.