GATTA (Graph Active Learning with Test-Time Augmentation) is introduced, a framework for enhancing active learning by aggregating predictions across multiple augmented views to produce more reliable uncertainty estimates, and generalizes across architectures, and outperforms model-side ensemble methods such as MC Dropout.
Abstract
Test-time augmentation (TTA) has proven effective for improving model robustness and uncertainty estimation in computer vision, yet its application to graph-structured data remains largely unexplored. We introduce GATTA (Graph Active Learning with Test-Time Augmentation), a framework for enhancing active learning by aggregating predictions across multiple augmented views to produce more reliable uncertainty estimates. To address the challenge of label-preserving graph augmentations, GATTA incorporates a consistency-based filtering mechanism that discards augmented views yielding unreliable predictions. We systematically evaluate GATTA across multiple graph datasets, GNN architectures, and acquisition strategies. Our results show that simple uncertainty-based methods, such as Entropy and Least Confidence, benefit most from TTA, achieving performance competitive with more sophisticated and computationally expensive approaches. GATTA generalizes across architectures, outperforms model-side ensemble methods such as MC Dropout. We further show that GATTA scales efficiently with both ensemble size and graph size. Extensive analysis of augmentation types, strengths, and filtering strategies provides practical guidelines for effective deployment. Our findings demonstrate that augmenting simple methods with TTA offers a more efficient path to strong active learning performance than engineering complex acquisition functions, enabling practitioners to achieve competitive results with lower computational overhead and reduced implementation complexity.
This paper proposes a novel model, ContraTGT, which employs a dual-view graph transformer, and puts forth an innovative, learnable data augmentation method, which involves selective masking of elements within dual-view sequences, thereby amplifying the potency of the contrastive learning approach.
Cang-Hong Jin, Jia-Feng Zhao, Feng Xu et al.· Proceedings of the Thirty-Fi...· 0 citations
This work introduces structure-aware entropy-based matching discrepancy, which jointly models feature uncertainty and structural coherence to ensure accurate feature adaptation between graphs and develops a domain-aware semi-hard negative sampling strategy that constructs informative contrastive sets by filtering unrel...
Ming-Can Wang, Jun-Chang Xin, Zhong-Ming Yao et al.· 0 citations
This work introduces ActiveAugment, a unified framework that treats augmentation selection as an online active learning problem, and reveals that the augmentation selection policy evolves meaningfully during training and that strategy choice has a direct impact on generalisation.
Graph distribution shifts between training and test graphs pose severe challenges to the generalization of graph neural networks (GNNs). In real-world deployment, application environments are continuously evolving, while retraining or redesigning GNNs is often costly and impractical. In light of this, test-time adaptat...
Jiayi Chen, Xin Zheng, Bo Li et al.· Proceedings of the Thirty-Fi...· 3 citations
A lightweight learnable augmentation framework based on Extreme Learning Machines for self-supervised visual representation learning that improves linear evaluation performance relative to reproduced baselines across most settings and demonstrates that lightweight learnable augmentation can effectively enhance self-sup...
This study introduces a novel memory-augmented self-learning framework that extracts and provides diverse learning sources for adaptive knowledge distillation from the student model itself, resulting in a 2.5-6% increase in accuracy across various benchmark datasets compared to current GNN training and self-distillatio...
Saurabh Sharma, Souvik Chowdhury, Joydeep Chandra· Data mining and knowledge di...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.