SOCKET: SOft Collision Kernel EsTimator for Sparse Attention
This work revisits Locality-Sensitive Hashing (LSH) and introduces SOCKET, a SOft Collision Kernel EsTimator that replaces hard bucket matches with probabilistic, similarity-aware aggregation, and reframes LSH from a candidate-generation mechanism into a principled scoring kernel for sparse attention.