Aug 2026· Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2· pp. 69-80· 0 citations· 38 references
TL;DR
This work realizes Access-Decoupled Recomputation as AFLiP, an efficient and structure-preserving framework for GNN-based link prediction, which matches or exceeds full-recomputation accuracy, while sampling and static reuse exhibit dataset-dependent degradation.
Abstract
Many GNN-based link prediction models use a shared message-passing encoder to amortize node encoding across edges. However, in practice, neighborhood expansion makes the edge-level mini-batches approach near full-graph computation, weakening this benefit. Existing scalable techniques enable efficient mini-batch training but make recomputation decisions implicitly via structural access, either recomputing all accessed nodes or only the target nodes in the batch. We propose Access-Decoupled Recomputation (ADR), which treats recomputation as an explicit optimization decision while preserving the original graph structure without neighborhood sampling. We realize ADR as AFLiP, an efficient and structure-preserving framework for GNN-based link prediction. Across diverse models and datasets, AFLiP matches or exceeds full-recomputation accuracy, while sampling and static reuse exhibit dataset-dependent degradation. Compared to full recomputation, AFLiP reaches the best checkpoint up to 3.1× faster and scales to web-scale graphs where full recomputation is infeasible, and achieves up to 16× higher throughput than sampling on Friendster.
HiLoRe is introduced, which allocates graph-attributed recovery units among high-precision storage, low-precision compression, and deterministic recomputation using measured recovery utility and update-conditioned approximation risk, and combines high-precision storage and deterministic recomputation with low-precision...
Xin-Rui Chen, Mengyang Li, Ou Wu et al.· 0 citations
This work formulate expert-cache management as a model-side algorithmic problem and proposes cache-aware post-training that jointly adapts the MoE backbone and lightweight auxiliary routers while preserving the native inference-time Top-K rule.
Zhenhe Wu, Ya-Ping Jin, Qing-Hua Xing et al.· 2 citations
This work proposes a BP-free algorithm, called ZeroLock, that decouples the model updates into independent chunk updates by local objective construction and provides the first theoretical framework for such local objective construction-based approaches under general model chunk division by mapping local objectives to t...
Wen-Tao Dai, Xuan-Ran Li, Yu-Xiang Zhang et al.· 0 citations
Experiments on five dynamic graph benchmarks show that CacheDyG adopts substantially fewer trainable parameters and lower runtime to obtain more competitive predictive performance than baselines, demonstrating that cache-based decoupling provides an effective principle for scalable dynamic graph learning.
PruneInfer is the only system on the authors' experimental configuration that maintains accuracy comparable to full-graph inference across all evaluated models and achieves up to 4.49 × speedup over DGL and up to 7.05 × speedup over GDL-GNN across the evaluated datasets.
Li-Yang Wu, Meng-Han Jia, Chun-Ye Gong et al.· Proceedings of the Internati...· 0 citations
This work proposes Turbo, a first-of-its-kind in-network aggregation system that accelerates long-context inference by offloading query broadcast and attention aggregation to switches and introduces a rolling forward scheme that propagates states to enable cross-stage updates.
Ying Wan, Yuchen Xu, Chuwen Zhang et al.· Conference on Applications,...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.