Bowen Wang

At-the-Roofline Sparse Tensor Contractions on Vector Processors for Transformer Inference

Ventaglio is presented, a runtime-configurable sparse execution unit coupled with RVV ISA extensions that drives sparse tensor contractions toward their roofline through indexed gather-accumulate-scatter support and achieves speedup over dense baselines during prefill and autoregressive decoding.