Timezone: »
Despite enormous successful applications of graph neural networks (GNNs), theoretical understanding of their generalization ability, especially for node-level tasks where data are not independent and identically-distributed (IID), has been sparse. The theoretical investigation of the generalization performance is beneficial for understanding fundamental issues (such as fairness) of GNN models and designing better learning methods. In this paper, we present a novel PAC-Bayesian analysis for GNNs under a non-IID semi-supervised learning setup. Moreover, we analyze the generalization performances on different subgroups of unlabeled nodes, which allows us to further study an accuracy-(dis)parity-style (un)fairness of GNNs from a theoretical perspective. Under reasonable assumptions, we demonstrate that the distance between a test subgroup and the training set can be a key factor affecting the GNN performance on that subgroup, which calls special attention to the training node selection for fair learning. Experiments across multiple GNN models and datasets support our theoretical results.
Author Information
Jiaqi Ma (University of Michigan)
Junwei Deng (University of Michigan)
Qiaozhu Mei (University of Michigan)
Related Events (a corresponding poster, oral, or spotlight)
-
2021 Spotlight: Subgroup Generalization and Fairness of Graph Neural Networks »
Dates n/a. Room
More from the Same Authors
-
2020 Poster: Towards More Practical Adversarial Attacks on Graph Neural Networks »
Jiaqi Ma · Shuangrui Ding · Qiaozhu Mei -
2019 : Poster Session #1 »
Adarsh Jamadandi · Sophia Sanborn · Huaxiu Yao · Chen Cai · Yu Chen · Jean-Marc Andreoli · Niklas Stoehr · Shih-Yang Su · Tony Duan · Fábio Ferreira · Davide Belli · Amit Boyarski · Ze Ye · Elahe Ghalebi · Arindam Sarkar · MAHMOUD KHADEMI · Evgeniy Faerman · Joey Bose · Jiaqi Ma · Lin Meng · Seyed Mehran Kazemi · Guangtao Wang · Tong Wu · Yuexin Wu · Chaitanya K. Joshi · Marc Brockschmidt · Daniele Zambon · Colin Graber · Rafaël Van Belle · Osman Asif Malik · Xavier Glorot · Mario Krenn · Chris Cameron · Binxuan Huang · George Stoica · Alexia Toumpa -
2019 Poster: A Flexible Generative Framework for Graph-based Semi-supervised Learning »
Jiaqi Ma · Weijing Tang · Ji Zhu · Qiaozhu Mei -
2012 Poster: GenDeR: A Generic Diversified Ranking Algorithm »
Jingrui He · Hanghang Tong · Qiaozhu Mei · Boleslaw K Szymanski