GAAC: Lossless KV Compression for Bandwidth-Efficient LLM Inference on Personal Devices
Group-Adaptive Additive Codec (GAAC), a lossless KV compression and serving system that exploits exponent redundancy to reduce storage and accelerate attention without introducing KV approximation, is presented.