Timezone: »
Graph convolutional networks (GCNs) have shown promising results in processing graph data by extracting structure-aware features. This gave rise to extensive work in geometric deep learning, focusing on designing network architectures that ensure neuron activations conform to regularity patterns within the input graph. However, in most cases the graph structure is only accounted for by considering the similarity of activations between adjacent nodes, which limits the capabilities of such methods to discriminate between nodes in a graph. Here, we propose to augment conventional GCNs with geometric scattering transforms and residual convolutions. The former enables band-pass filtering of graph signals, thus alleviating the so-called oversmoothing often encountered in GCNs, while the latter is introduced to clear the resulting features of high-frequency noise. We establish the advantages of the presented Scattering GCN with both theoretical results establishing the complementary benefits of scattering and GCN features, as well as experimental results showing the benefits of our method compared to leading graph neural networks for semi-supervised node classification, including the recently proposed GAT network that typically alleviates oversmoothing using graph attention mechanisms.
Author Information
Yimeng Min (Mila)
Frederik Wenkel (Mila, Université de Montréal)
Frederik Wenkel is a PhD candidate in Applied Mathematics at Université de Montréal and Mila (the Quebec AI institute) working on Geometric Deep Learning. In particular, he is interested in Graph Neural Networks and their applications in domains such as Social Networks, Biochemistry and Finance. He holds a bachelor’s and master’s degree in Mathematics at Technical University of Munich.
Guy Wolf (Université de Motréal; Mila)
More from the Same Authors
-
2022 : Deceiving the CKA Similarity Measure in Deep Learning »
MohammadReza Davari · Stefan Horoi · Amine Natik · Guillaume Lajoie · Guy Wolf · Eugene Belilovsky -
2022 Spotlight: Lightning Talks 6A-4 »
Xiu-Shen Wei · Konstantina Dritsa · Guillaume Huguet · ABHRA CHAUDHURI · Zhenbin Wang · Kevin Qinghong Lin · Yutong Chen · Jianan Zhou · Yongsen Mao · Junwei Liang · Jinpeng Wang · Mao Ye · Yiming Zhang · Aikaterini Thoma · H.-Y. Xu · Daniel Sumner Magruder · Enwei Zhang · Jianing Zhu · Ronglai Zuo · Massimiliano Mancini · Hanxiao Jiang · Jun Zhang · Fangyun Wei · Faen Zhang · Ioannis Pavlopoulos · Zeynep Akata · Xiatian Zhu · Jingfeng ZHANG · Alexander Tong · Mattia Soldan · Chunhua Shen · Yuxin Peng · Liuhan Peng · Michael Wray · Tongliang Liu · Anjan Dutta · Yu Wu · Oluwadamilola Fasina · Panos Louridas · Angel Chang · Manik Kuchroo · Manolis Savva · Shujie LIU · Wei Zhou · Rui Yan · Gang Niu · Liang Tian · Bo Han · Eric Z. XU · Guy Wolf · Yingying Zhu · Brian Mak · Difei Gao · Masashi Sugiyama · Smita Krishnaswamy · Rong-Cheng Tu · Wenzhe Zhao · Weijie Kong · Chengfei Cai · WANG HongFa · Dima Damen · Bernard Ghanem · Wei Liu · Mike Zheng Shou -
2022 Spotlight: Manifold Interpolating Optimal-Transport Flows for Trajectory Inference »
Guillaume Huguet · Daniel Sumner Magruder · Alexander Tong · Oluwadamilola Fasina · Manik Kuchroo · Guy Wolf · Smita Krishnaswamy -
2022 Poster: Long Range Graph Benchmark »
Vijay Prakash Dwivedi · Ladislav Rampášek · Mikhail Galkin · Ali Parviz · Guy Wolf · Anh Tuan Luu · Dominique Beaini -
2022 Poster: Can Hybrid Geometric Scattering Networks Help Solve the Maximum Clique Problem? »
Yimeng Min · Frederik Wenkel · Michael Perlmutter · Guy Wolf -
2022 Poster: Manifold Interpolating Optimal-Transport Flows for Trajectory Inference »
Guillaume Huguet · Daniel Sumner Magruder · Alexander Tong · Oluwadamilola Fasina · Manik Kuchroo · Guy Wolf · Smita Krishnaswamy -
2022 Poster: Recipe for a General, Powerful, Scalable Graph Transformer »
Ladislav Rampášek · Mikhail Galkin · Vijay Prakash Dwivedi · Anh Tuan Luu · Guy Wolf · Dominique Beaini -
2021 : Multimodal Single-Cell Data Integration + Q&A »
Daniel Burkhardt · Smita Krishnaswamy · Malte Luecken · Debora Marks · Angela Pisco · Bastian Rieck · Jian Tang · Alexander Tong · Fabian Theis · Guy Wolf -
2020 : Extendable and invertible manifold learning with geometry regularized autoencoders »
Andres F Duque · Sacha Morin · Guy Wolf · Kevin Moon -
2020 : Closing Remarks »
Frederic Chazal · Smita Krishnaswamy · Roland Kwitt · Karthikeyan Natesan Ramamurthy · Bastian Rieck · Yuhei Umeda · Guy Wolf -
2020 Workshop: Topological Data Analysis and Beyond »
Bastian Rieck · Frederic Chazal · Smita Krishnaswamy · Roland Kwitt · Karthikeyan Natesan Ramamurthy · Yuhei Umeda · Guy Wolf -
2020 : Opening Remarks »
Frederic Chazal · Smita Krishnaswamy · Roland Kwitt · Karthikeyan Natesan Ramamurthy · Bastian Rieck · Yuhei Umeda · Guy Wolf -
2020 Poster: Uncovering the Topology of Time-Varying fMRI Data using Cubical Persistence »
Bastian Rieck · Tristan Yates · Christian Bock · Karsten Borgwardt · Guy Wolf · Nicholas Turk-Browne · Smita Krishnaswamy -
2020 Spotlight: Uncovering the Topology of Time-Varying fMRI Data using Cubical Persistence »
Bastian Rieck · Tristan Yates · Christian Bock · Karsten Borgwardt · Guy Wolf · Nicholas Turk-Browne · Smita Krishnaswamy -
2018 Poster: Geometry Based Data Generation »
Ofir Lindenbaum · Jay Stanley · Guy Wolf · Smita Krishnaswamy -
2018 Spotlight: Geometry Based Data Generation »
Ofir Lindenbaum · Jay Stanley · Guy Wolf · Smita Krishnaswamy