Timezone: »
Prevailing deep graph learning models often suffer from label sparsity issue. Although many graph few-shot learning (GFL) methods have been developed to avoid the performance degradation in face of limited annotated data, they excessively rely on labeled data, where the distribution shift in the test phase might result in impaired generalization ability. Additionally, they lack a general purpose as their designs are coupled with task or data-specific characteristics. To this end, we propose a general and effective Contrastive-Graph Few-shot Learning framework (CGFL). CGFL leverages a self-distilled contrastive learning procedure to boost GFL. Specifically, our model firstly pre-trains a graph encoder with contrastive learning using unlabeled data. Later, the trained encoder is frozen as a teacher model to distill a student model with a contrastive loss. The distilled model is finally fed to GFL. CGFL learns data representation in a self-supervised manner, thus mitigating the distribution shift impact for better generalization and making model task and data-independent for a general graph mining purpose. Furthermore, we introduce an information-based method to quantitatively measure the capability of CGFL. Comprehensive experiments demonstrate that CGFL outperforms state-of-the-art baselines on several graph mining tasks in the few-shot scenario. We also provide quantitative measurement of CGFL's success.
Author Information
Chunhui Zhang (Brandeis University)
Hongfu Liu (Brandeis University)
Jundong Li (University of Virginia)
Yanfang Ye (University of Notre Dame)
Chuxu Zhang (Brandeis University)
More from the Same Authors
-
2022 Poster: Label-invariant Augmentation for Semi-Supervised Graph Classification »
Han Yue · Chunhui Zhang · Chuxu Zhang · Hongfu Liu -
2022 Poster: TwiBot-22: Towards Graph-Based Twitter Bot Detection »
Shangbin Feng · Zhaoxuan Tan · Herun Wan · Ningnan Wang · Zilong Chen · Binchi Zhang · Qinghua Zheng · Wenqian Zhang · Zhenyu Lei · Shujie Yang · Xinshun Feng · Qingyue Zhang · Hongrui Wang · Yuhan Liu · Yuyang Bai · Heng Wang · Zijian Cai · Yanbo Wang · Lijing Zheng · Zihan Ma · Jundong Li · Minnan Luo -
2022 : Graph Contrastive Learning with Cross-view Reconstruction »
Qianlong Wen · Zhongyu Ouyang · Chunhui Zhang · Yiyue Qian · Yanfang Ye · Chuxu Zhang -
2022 : Diving into Unified Data-Model Sparsity for Class-Imbalanced Graph Representation Learning »
Chunhui Zhang · Chao Huang · Yijun Tian · Qianlong Wen · Zhongyu Ouyang · Youhuan Li · Yanfang Ye · Chuxu Zhang -
2022 : NOSMOG: Learning Noise-robust and Structure-aware MLPs on Graphs »
Yijun Tian · Chuxu Zhang · Zhichun Guo · Xiangliang Zhang · Nitesh Chawla -
2023 Poster: GraphPatcher: Mitigating Degree Bias for Graph Neural Networks via Test-time Node Patching »
Mingxuan Ju · Tong Zhao · Wenhao Yu · Neil Shah · Yanfang Ye -
2022 Spotlight: TwiBot-22: Towards Graph-Based Twitter Bot Detection »
Shangbin Feng · Zhaoxuan Tan · Herun Wan · Ningnan Wang · Zilong Chen · Binchi Zhang · Qinghua Zheng · Wenqian Zhang · Zhenyu Lei · Shujie Yang · Xinshun Feng · Qingyue Zhang · Hongrui Wang · Yuhan Liu · Yuyang Bai · Heng Wang · Zijian Cai · Yanbo Wang · Lijing Zheng · Zihan Ma · Jundong Li · Minnan Luo -
2022 Poster: BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphs »
Kay Liu · Yingtong Dou · Yue Zhao · Xueying Ding · Xiyang Hu · Ruitong Zhang · Kaize Ding · Canyu Chen · Hao Peng · Kai Shu · Lichao Sun · Jundong Li · George H Chen · Zhihao Jia · Philip S Yu -
2022 Poster: Multi-objective Deep Data Generation with Correlated Property Control »
Shiyu Wang · Xiaojie Guo · Xuanyang Lin · Bo Pan · Yuanqi Du · Yinkai Wang · Yanfang Ye · Ashley Petersen · Austin Leitgeb · Saleh Alkhalifa · Kevin Minbiole · William M. Wuest · Amarda Shehu · Liang Zhao -
2022 Poster: CLEAR: Generative Counterfactual Explanations on Graphs »
Jing Ma · Ruocheng Guo · Saumitra Mishra · Aidong Zhang · Jundong Li -
2022 Poster: Graph Few-shot Learning with Task-specific Structures »
Song Wang · Chen Chen · Jundong Li -
2022 Poster: Co-Modality Graph Contrastive Learning for Imbalanced Node Classification »
Yiyue Qian · Chunhui Zhang · Yiming Zhang · Qianlong Wen · Yanfang Ye · Chuxu Zhang -
2021 Poster: Implicit Semantic Response Alignment for Partial Domain Adaptation »
Wenxiao Xiao · Zhengming Ding · Hongfu Liu