S$^4$R: Selective Sampling, Subspaces, and Sparse Reconstruction for Compressed Long-Context KV Caching
S$^4$R is proposed, which builds low-rank subspaces from selectively sampled tokens and computes attention over a sparsely reconstructed KV representation, combining the efficiency of fixed compression with the adaptability of prompt-dependent methods.