Jia-Qi Si

LEO: Enabling Efficient Communication-Computation Pipeline for GNN via Hierarchical Caching

Training large-scale graphs with GNNs on multi-GPU platforms faces substantial feature loading overhead, leading to low resource utilization and inefficient training. Overcoming such communication bottlenecks is crucial, and current solutions achieve this by overlapping computation and communication through pipelining....