Efficient Distributed Mini-Batch GNN Training With Decentralized Batch Processing
Distributed mini-batch Graph Neural Network (GNN) training is a crucial technique for learning large-scale graphs. Existing training methods typically rely on a centralized batch processing pipeline, where a single worker manages the entire lifespan of a batch. Consequently, the communication volume is linearly proport...