Timezone: »
Most of the successful deep neural network architectures are structured, often consisting of elements like convolutional neural networks and gated recurrent neural networks. Recently, graph neural networks (GNNs) have been successfully applied to graph-structured data such as point cloud and molecular data. These networks often only consider pairwise dependencies, as they operate on a graph structure. We generalize the GNN into a factor graph neural network (FGNN) providing a simple way to incorporate dependencies among multiple variables. We show that FGNN is able to represent Max-Product belief propagation, an approximate inference method on probabilistic graphical models, providing a theoretical understanding on the capabilities of FGNN and related GNNs. Experiments on synthetic and real datasets demonstrate the potential of the proposed architecture.
Author Information
Zhen Zhang (University of Adelaide)
Fan Wu (University of Illinois at Urbana-Champaign)
Wee Sun Lee (National University of Singapore)
Wee Sun Lee is a professor in the Department of Computer Science, National University of Singapore. He obtained his B.Eng from the University of Queensland in 1992 and his Ph.D. from the Australian National University in 1996. He has been a research fellow at the Australian Defence Force Academy, a fellow of the Singapore-MIT Alliance, and a visiting scientist at MIT. His research interests include machine learning, planning under uncertainty, and approximate inference. His works have won the Test of Time Award at Robotics: Science and Systems (RSS) 2021, the RoboCup Best Paper Award at International Conference on Intelligent Robots and Systems (IROS) 2015, the Google Best Student Paper Award, Uncertainty in AI (UAI) 2014 (as faculty co-author), as well as several competitions and challenges. He has been an area chair for machine learning and AI conferences such as the Neural Information Processing Systems (NeurIPS), the International Conference on Machine Learning (ICML), the AAAI Conference on Artificial Intelligence (AAAI), and the International Joint Conference on Artificial Intelligence (IJCAI). He was a program, conference and journal track co-chair for the Asian Conference on Machine Learning (ACML), and he is currently the co-chair of the steering committee of ACML.
More from the Same Authors
-
2022 : Efficient Offline Policy Optimization with a Learned Model »
Zichen Liu · Siyi Li · Wee Sun Lee · Shuicheng Yan · Zhongwen Xu -
2022 Poster: Truncated Matrix Power Iteration for Differentiable DAG Learning »
Zhen Zhang · Ignavier Ng · Dong Gong · Yuhang Liu · Ehsan Abbasnejad · Mingming Gong · Kun Zhang · Javen Qinfeng Shi -
2021 : Part 4: Appendix: Proofs and Derivations »
Wee Sun Lee -
2021 : Part 3: Graph Neural Networks and Attention Networks »
Wee Sun Lee -
2021 : Part 2: Markov Decision Process »
Wee Sun Lee -
2021 Tutorial: Message Passing In Machine Learning »
Wee Sun Lee -
2021 : Part 1: Message Passing Overview and Probabilistic Graphical Models »
Wee Sun Lee -
2017 Poster: QMDP-Net: Deep Learning for Planning under Partial Observability »
Peter Karkus · David Hsu · Wee Sun Lee -
2015 Poster: Adaptive Stochastic Optimization: From Sets to Paths »
Zhan Wei Lim · David Hsu · Wee Sun Lee -
2013 Poster: DESPOT: Online POMDP Planning with Regularization »
Adhiraj Somani · Nan Ye · David Hsu · Wee Sun Lee -
2013 Poster: Learning with Invariance via Linear Functionals on Reproducing Kernel Hilbert Space »
Xinhua Zhang · Wee Sun Lee · Yee Whye Teh -
2013 Spotlight: Learning with Invariance via Linear Functionals on Reproducing Kernel Hilbert Space »
Xinhua Zhang · Wee Sun Lee · Yee Whye Teh -
2013 Poster: Active Learning for Probabilistic Hypotheses Using the Maximum Gibbs Error Criterion »
Nguyen Viet Cuong · Wee Sun Lee · Nan Ye · Kian Ming Adam Chai · Hai Leong Chieu -
2011 Poster: Monte Carlo Value Iteration with Macro-Actions »
Zhan Wei Lim · David Hsu · Wee Sun Lee -
2010 Session: Oral Session 2 »
Wee Sun Lee -
2009 Poster: Conditional Random Fields with High-Order Features for Sequence Labeling »
Nan Ye · Wee Sun Lee · Hai Leong Chieu · Dan Wu -
2007 Poster: Cooled and Relaxed Survey Propagation for MRFs »
Hai Leong Chieu · Wee Sun Lee · Yee Whye Teh -
2007 Spotlight: Cooled and Relaxed Survey Propagation for MRFs »
Hai Leong Chieu · Wee Sun Lee · Yee Whye Teh -
2007 Spotlight: What makes some POMDP problems easy to approximate? »
David Hsu · Wee Sun Lee · Nan Rong -
2007 Poster: What makes some POMDP problems easy to approximate? »
David Hsu · Wee Sun Lee · Nan Rong -
2006 Poster: Hyperparameter Learning for Graph Based Semi-supervised Learning Algorithms »
Xinhua Zhang · Wee Sun Lee