SpBatch: Reclaiming Lost Sparsity for Batched Sparse FFN Execution
Results demonstrate that activation sparsity and batch processing can be jointly leveraged through a selective sparse FFN execution path, especially in small-to-moderate batch regimes and high-sparsity edge-oriented scenarios where dense execution does not yet fully dominate.