Timezone: »

 
Convolutional Neural Networks on Manifolds: From Graphs and Back
Zhiyang Wang · Luana Ruiz · Alejandro Ribeiro

@
in New Frontiers in Graph Learning »
Event URL: https://openreview.net/forum?id=sjk2IiF9tiY »

In recent years, geometric deep learning has gained attraction due to both the need for machine learning on structured data (e.g., graphs) and the increasing availability of this type of data. Extensions of deep convolutional architectures to non-Euclidean domains in particular are a powerful technique in sensor network applications --- which can be seen as graphs --- and 3D model analysis --- which can be seen as manifolds. While recent works have provided a better theoretical understanding of why convolutional neural network architectures work well on graphs of moderate size, in the large-scale regime that is the setting of most problems of interest, their behavior is not as well understood. In this paper, we bridge this gap by modeling large graphs as samples from manifolds and studying manifold neural networks (MNNs). Our main contribution is to define a manifold convolution operation which, when ``discretized'' in both the space and time domains, is consistent with the practical implementation of a graph convolution. We then show that graph neural networks (GNNs) can be particularized from MNNs, which in turn are the limits of these GNNs. We conclude with numerical experiments showcasing an application of the MNN to point-cloud classification.

Author Information

Zhiyang Wang (University of Pennsylvania)
Luana Ruiz (University of Pennsylvania)

Luana Ruiz received the B.Sc. degree in electrical engineering from the University of São Paulo, Brazil, and the M.Sc. degree in electrical engineering from the École Supérieure d'Electricité (now CentraleSupélec), France, in 2017. She is currently a Ph.D. candidate with the Department of Electrical and Systems Engineering at the University of Pennsylvania. Her research interests are in the fields of graph signal processing and machine learning over network data. She was awarded an Eiffel Excellence scholarship from the French Ministry for Europe and Foreign Affairs between 2013 and 2015 and, in 2019, received a best student paper award at the 27th European Signal Processing Conference.

Alejandro Ribeiro (University of Pennsylvania)

More from the Same Authors