Xiaojuan Tang

HISA: Efficient Hierarchical Indexing for Fine-Grained Sparse Attention

This work proposes HISA (Hierarchical Indexed Sparse Attention), a plug-and-play replacement for the indexer that rewrites the search path from a flat token scan into a two-stage hierarchical procedure: a block-level coarse filtering stage that scores pooled block representations to discard irrelevant regions, followed...