Timezone: »
Recent work has shown that a simple, fast method called Simple Graph Convolution (SGC) (Wu et al., 2019), which eschews deep learning, is competitive with deep methods like graph convolutional networks (GCNs) (Kipf & Welling, 2017) in common graph machine learning benchmarks. The use of graph data in SGC implicitly assumes the common but not universal graph characteristic of homophily, wherein nodes link to nodes which are similar. Here we confirm that SGC is indeed ineffective for heterophilous (i.e., non-homophilous) graphs via experiments on synthetic and real-world datasets. We propose Adaptive Simple Graph Convolution (ASGC), which we show can adapt to both homophilous and heterophilous graph structure. Like SGC, ASGC is not a deep model, and hence is fast, scalable, and interpretable; further, we can prove performance guarantees on natural synthetic data models. Empirically, ASGC is often competitive with recent deep models at node classification on a benchmark of real-world datasets. The SGC paper questioned whether the complexity of graph neural networks is warranted for common graph problems involving homophilous networks; our results similarly suggest that, while deep learning often achieves the highest performance, heterophilous structure alone does not necessitate these more involved methods.
Author Information
Sudhanshu Chanpuriya (University of Massachusetts, Amherst)
Cameron Musco (University of Massachusetts Amherst)
More from the Same Authors
-
2023 Poster: No-regret Algorithms for Fair Resource Allocation »
Abhishek Sinha · Ativ Joshi · Rajarshi Bhattacharjee · Cameron Musco · Mohammad Hajiesmaili -
2023 Poster: Exact Representation of Sparse Networks with Symmetric Nonnegative Embeddings »
Sudhanshu Chanpuriya · Ryan Rossi · Anup Rao · Tung Mai · Nedim Lipka · Zhao Song · Cameron Musco -
2023 Poster: Finite Population Regression Adjustment and Non-asymptotic Guarantees for Treatment Effect Estimation »
Mehrdad Ghadiri · David Arbour · Tung Mai · Cameron Musco · Anup Rao -
2022 Spotlight: Kernel Interpolation with Sparse Grids »
Mohit Yadav · Daniel Sheldon · Cameron Musco -
2022 Poster: Kernel Interpolation with Sparse Grids »
Mohit Yadav · Daniel Sheldon · Cameron Musco -
2022 Poster: Modeling Transitivity and Cyclicity in Directed Graphs via Binary Code Box Embeddings »
Dongxu Zhang · Michael Boratko · Cameron Musco · Andrew McCallum -
2022 Poster: Sample Constrained Treatment Effect Estimation »
Raghavendra Addanki · David Arbour · Tung Mai · Cameron Musco · Anup Rao -
2021 Poster: On the Power of Edge Independent Graph Models »
Sudhanshu Chanpuriya · Cameron Musco · Konstantinos Sotiropoulos · Charalampos Tsourakakis -
2021 Poster: Coresets for Classification – Simplified and Strengthened »
Tung Mai · Cameron Musco · Anup Rao -
2020 Poster: Fourier Sparse Leverage Scores and Approximate Kernel Learning »
Tamas Erdelyi · Cameron Musco · Christopher Musco -
2020 Spotlight: Fourier Sparse Leverage Scores and Approximate Kernel Learning »
Tamas Erdelyi · Cameron Musco · Christopher Musco -
2020 Poster: Node Embeddings and Exact Low-Rank Representations of Complex Networks »
Sudhanshu Chanpuriya · Cameron Musco · Konstantinos Sotiropoulos · Charalampos Tsourakakis -
2019 Poster: Toward a Characterization of Loss Functions for Distribution Learning »
Nika Haghtalab · Cameron Musco · Bo Waggoner