SpBatch: Reclaiming Lost Sparsity for Batched Sparse FFN Execution
Results demonstrate that activation sparsity and batch processing can be jointly leveraged through a selective sparse FFN execution path, especially in small-to-moderate batch regimes and high-sparsity edge-oriented scenarios where dense execution does not yet fully dominate.
Zhi-Xiong Zhang, Zhong-Xiang Wei, Zhao-Han Wang et al.
· IEEE transactions on compute... · 0 citations