A Propagation-aware Graph Foundation Model (ProGFM), which regards the propagation relationships between edges and feature dimensions as transferable knowledge units, and exhibits superior generalization performance compared with existing methods.
Abstract
Graph Foundation Models (GFMs) have recently emerged as a promising paradigm for enabling knowledge transfer across diverse domains. Unlike traditional graph learning methods that are typically designed for in-domain settings, GFMs aim to learn transferable knowledge that can generalize to unseen graph domains. However, unlike language or visual data, graphs lack intrinsic and unified representation units, such as tokens in language and patches in vision, making it challenging to identify transferable knowledge units for building graph foundation models. Existing graph foundation models mainly focus on mitigating domain discrepancies through feature alignment and structure alignment, while overlooking the exploration of transferable knowledge units underlying graph data. Moreover, these methods generally rely on fixed propagation mechanisms during message passing, overlooking the heterogeneity in propagation patterns, as different edges may exhibit distinct propagation patterns for different feature dimensions. To address these limitations, we propose a Propagation-aware Graph Foundation Model (ProGFM), which regards the propagation relationships between edges and feature dimensions as transferable knowledge units. Through a propagation relationship prototype bank, ProGFM learns cross-domain transferable propagation knowledge, enabling adaptive information aggregation in unseen graph domains. Extensive experiments across various cross-domain transfer scenarios demonstrate that ProGFM possesses strong cross-domain knowledge transfer capability and exhibits superior generalization performance compared with existing methods.
SliGFM is proposed, a graph foundation model built upon topology-aware sliding-window feature encoding and generative reconstruction that enables a smoothness-aware transformer to capture transferable relational patterns among feature tokens within each node, while the generative reconstruction objective encourages pre...
The proposed framework provides a scalable foundation for graph-based artificial intelligence and has applications in biomedical knowledge discovery, financial fraud detection, industrial digital twins, recommendation systems, cybersecurity intelligence, scientific literature mining, and smart governance.
Seppo Linnainmaa, A. Salomaa· International Journal of Eme...· 0 citations
This framework performs LLM knowledge elicitation to extract factual knowledge from the model’s internal representations and transforms sentence-level representations into entity-level representations and aligns them within a unified space.
Deyu Chen, Qi-Yuan Li, Jinguang Gu et al.· Proceedings of the Thirty-Fi...· 0 citations
P PogRE (Pattern Over-Generalization Robust Embedding), a simple but effective method that utilizes dense linear transformations and compound operations for relation representation that effectively addresses the negative impact of over-generalization.
This work proposes COllabOrative Knowledge Extraction and integRation (COOKER) method for GDIL to mine inter-domain relationships and uncover the potential of domain-agnostic representations, which significantly outperforms existing baselines.
Jialu Li, Yu Wang, Wanyu Lin et al.· Proceedings of the 32nd ACM...· 0 citations
ViSR-KGC, a visual subgraph reasoning approach for KGC, integrates three complementary capabilities to capture semantic correlations: identifying global topology dependencies via representation learning, analyzing local multimodal evidence using VLMs, and providing necessary commonsense knowledge inherent in pre-traine...
Jiafan Li, Meng-Xue Yang, Jiaqi Zhu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.