Preprint
Sep 2026
Entwine: Coordinating Tiled Computation and Fine-Grained Communication across GPUs
Modern high-performance GPU computations partition tensors into tiles to exploit data reuse and parallelism. Individual tile computations complete earlier than the full tensor computation, creating opportunities to overlap computation and communication. However, a mismatch between computation and communication progress...
Kai Ma, Quan-Feng Lv, Jing-Guo Ge et al.
· 0 citations