HyCo2: Hybrid Context Compression with Global Semantics and Local Evidence
Long-context inference is costly and can be brittle for large language models (LLMs): self-attention grows quadratically with input length, and retrieval-augmented generation (RAG) may introduce redundant context that obscures decisive evidence. Existing compressors face a representational trade-off. Hard compression k...