Timezone: »
To alleviate the unfavorable effect of noisy topology in Graph Neural networks (GNNs), some efforts perform the local topology refinement through the pairwise propagation weight learning and the multi-channel extension. Unfortunately, most of them suffer a common and fatal drawback: irrelevant propagation to one node and in multi-channels. These two kinds of irrelevances make propagation weights in multi-channels free to be determined by the labeled data, and thus the GNNs are exposed to overfitting. To tackle this issue, a novel Orthogonal Propagation with Ego-Network modeling (OPEN) is proposed by modeling relevances between propagations. Specifically, the relevance between propagations to one node is modeled by whole ego-network modeling, while the relevance between propagations in multi-channels is modeled via diversity requirement. By interpreting the propagations to one node from the perspective of dimension reduction, propagation weights are inferred from principal components of the ego-network, which are orthogonal to each other. Theoretical analysis and experimental evaluations reveal four attractive characteristics of OPEN as modeling high-order relationships beyond pairwise one, preventing overfitting, robustness, and high efficiency.
Author Information
Liang Yang (Hebei University of Technology)
Lina Kang (Hebei University of Technology)
Qiuliang Zhang (河北工业大学)
Mengzhe Li (Hebei University of Technology)
bingxin niu (Hebei University of Techonology)
Dongxiao He (Jilin University, China)
Zhen Wang (Northwestern Polytechnical University)
Chuan Wang (institute of information engineering)
Xiaochun Cao (SUN YAT-SEN UNIVERSITY)
Yuanfang Guo (Beihang University)
More from the Same Authors
-
2022 Spotlight: OpenAUC: Towards AUC-Oriented Open-Set Recognition »
Zitai Wang · Qianqian Xu · Zhiyong Yang · Yuan He · Xiaochun Cao · Qingming Huang -
2022 Poster: OpenAUC: Towards AUC-Oriented Open-Set Recognition »
Zitai Wang · Qianqian Xu · Zhiyong Yang · Yuan He · Xiaochun Cao · Qingming Huang -
2022 Poster: Rethinking Image Restoration for Object Detection »
Shangquan Sun · Wenqi Ren · Tao Wang · Xiaochun Cao -
2022 Poster: OTKGE: Multi-modal Knowledge Graph Embeddings via Optimal Transport »
Zongsheng Cao · Qianqian Xu · Zhiyong Yang · Yuan He · Xiaochun Cao · Qingming Huang -
2022 Poster: The Minority Matters: A Diversity-Promoting Collaborative Metric Learning Algorithm »
Shilong Bao · Qianqian Xu · Zhiyong Yang · Yuan He · Xiaochun Cao · Qingming Huang -
2021 Poster: Universal Graph Convolutional Networks »
Di Jin · Zhizhi Yu · Cuiying Huo · Rui Wang · Xiao Wang · Dongxiao He · Jiawei Han -
2021 Poster: Diverse Message Passing for Attribute with Heterophily »
Liang Yang · Mengzhe Li · Liyang Liu · bingxin niu · Chuan Wang · Xiaochun Cao · Yuanfang Guo