DistSpMM: Accelerating Sparse Matrix Dense Matrix Multiplication on GPUs
The proposed DistSpMM proposes DistSpMM, a co-design framework integrating data layout, pipelining, and communication strategies, which introduces HSDMA, a lightweight algorithm that reduces communication by optimizing the dense matrix allocation.