Aug 2026· Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2· pp. 69-80· 0 citations· 10 references
Abstract
Many GNN-based link prediction models use a shared message-passing encoder to amortize node encoding across edges. However, in practice, neighborhood expansion makes the edge-level mini-batches approach near full-graph computation, weakening this benefit. Existing scalable techniques enable efficient mini-batch training but make recomputation decisions implicitly via structural access, either recomputing all accessed nodes or only the target nodes in the batch. We propose Access-Decoupled Recomputation (ADR), which treats recomputation as an explicit optimization decision while preserving the original graph structure without neighborhood sampling. We realize ADR as AFLiP, an efficient and structure-preserving framework for GNN-based link prediction. Across diverse models and datasets, AFLiP matches or exceeds full-recomputation accuracy, while sampling and static reuse exhibit dataset-dependent degradation. Compared to full recomputation, AFLiP reaches the best checkpoint up to 3.1× faster and scales to web-scale graphs where full recomputation is infeasible, and achieves up to 16× higher throughput than sampling on Friendster.
Modern large language model (LLM) inference suffers from severe Time-To-First-Token (TTFT) bottlenecks. Existing prefix KV caching mechanisms are inherently stateless, forcing a trade-off between cross-chunk attention accuracy and online recomputation overhead. To address this issue, we propose Pegasus, a novel statefu...
Fahao Chen, Peng Li, Dongxiao Yu et al.· Fall Joint Computer Conferen...· 0 citations
This work formulate expert-cache management as a model-side algorithmic problem and proposes cache-aware post-training that jointly adapts the MoE backbone and lightweight auxiliary routers while preserving the native inference-time Top-K rule.
Zhenhe Wu, Ya-Ping Jin, Qing-Hua Xing et al.· 2 citations
This work proposes a BP-free algorithm, called ZeroLock, that decouples the model updates into independent chunk updates by local objective construction and provides the first theoretical framework for such local objective construction-based approaches under general model chunk division by mapping local objectives to t...
Wen-Tao Dai, Xuan-Ran Li, Yu-Xiang Zhang et al.· 0 citations
This work proposes Turbo, a first-of-its-kind in-network aggregation system that accelerates long-context inference by offloading query broadcast and attention aggregation to switches and introduces a rolling forward scheme that propagates states to enable cross-stage updates.
Ying Wan, Yuchen Xu, Chuwen Zhang et al.· Conference on Applications,...· 0 citations
AceSpec, an asymmetric edge-cloud collaborative framework that employs an asymmetric communication protocol that transmits minimal main-chain indices uplink and compact sparse distributions downlink and introduces a network-aware, Lagrangian-optimized resource allocation strategy that dynamically maximizes the local ca...
Yi-Da Zhang, Zhi-Yong Gao, Shuai-Bing Yue et al.· 0 citations
This work presents a unified formulation of LLM routing as a sequential decision process characterized by five components: context encoders, model encoders, scoring functions, decision rules, and learning signals, covering single-turn, multi-turn, and personalized routing.
Tao Feng, Fangxu Yu, Haozhen Zhang et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.