Timezone: »
Graph structured data are abundant in the real world. Among different graph types, directed acyclic graphs (DAGs) are of particular interest to machine learning researchers, as many machine learning models are realized as computations on DAGs, including neural networks and Bayesian networks. In this paper, we study deep generative models for DAGs, and propose a novel DAG variational autoencoder (D-VAE). To encode DAGs into the latent space, we leverage graph neural networks. We propose an asynchronous message passing scheme that allows encoding the computations on DAGs, rather than using existing simultaneous message passing schemes to encode local graph structures. We demonstrate the effectiveness of our proposed DVAE through two tasks: neural architecture search and Bayesian network structure learning. Experiments show that our model not only generates novel and valid DAGs, but also produces a smooth latent space that facilitates searching for DAGs with better performance through Bayesian optimization.
Author Information
Muhan Zhang (Washington University; Facebook (now))
Shali Jiang (Washington University in St. Louis)
Zhicheng Cui (Washington University in St. Louis)
Roman Garnett (Washington University in St. Louis)
Yixin Chen (Washington University in St. Louis)
More from the Same Authors
-
2022 Poster: Rethinking Knowledge Graph Evaluation Under the Open-World Assumption »
Haotong Yang · Zhouchen Lin · Muhan Zhang -
2022 : Panel »
Roman Garnett · José Miguel Hernández-Lobato · Eytan Bakshy · Syrine Belakaria · Stefanie Jegelka -
2022 Poster: Local Bayesian optimization via maximizing probability of descent »
Quan Nguyen · Kaiwen Wu · Jacob Gardner · Roman Garnett -
2022 Poster: Geodesic Graph Neural Network for Efficient Graph Representation Learning »
Lecheng Kong · Yixin Chen · Muhan Zhang -
2022 Poster: How Powerful are K-hop Message Passing Graph Neural Networks »
Jiarui Feng · Yixin Chen · Fuhai Li · Anindya Sarkar · Muhan Zhang -
2021 Poster: Decoupling the Depth and Scope of Graph Neural Networks »
Hanqing Zeng · Muhan Zhang · Yinglong Xia · Ajitesh Srivastava · Andrey Malevich · Rajgopal Kannan · Viktor Prasanna · Long Jin · Ren Chen -
2021 Poster: Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learning »
Muhan Zhang · Pan Li · Yinglong Xia · Kai Wang · Long Jin -
2021 Poster: Nested Graph Neural Networks »
Muhan Zhang · Pan Li -
2020 Poster: Efficient Nonmyopic Bayesian Optimization via One-Shot Multi-Step Trees »
Shali Jiang · Daniel Jiang · Maximilian Balandat · Brian Karrer · Jacob Gardner · Roman Garnett -
2019 Poster: Cost Effective Active Search »
Shali Jiang · Roman Garnett · Benjamin Moseley -
2018 Poster: Efficient nonmyopic batch active search »
Shali Jiang · Gustavo Malkomes · Matthew Abbott · Benjamin Moseley · Roman Garnett -
2018 Spotlight: Efficient nonmyopic batch active search »
Shali Jiang · Gustavo Malkomes · Matthew Abbott · Benjamin Moseley · Roman Garnett -
2018 Poster: Link Prediction Based on Graph Neural Networks »
Muhan Zhang · Yixin Chen -
2018 Poster: Automating Bayesian optimization with Bayesian optimization »
Gustavo Malkomes · Roman Garnett -
2018 Spotlight: Link Prediction Based on Graph Neural Networks »
Muhan Zhang · Yixin Chen -
2016 Poster: Bayesian optimization for automated model selection »
Gustavo Malkomes · Charles Schaff · Roman Garnett -
2015 : *Roman Garnett* Bayesian Quadrature: Lessons Learned and Looking Forwards »
Roman Garnett -
2015 Poster: Bayesian Active Model Selection with an Application to Automated Audiometry »
Jacob Gardner · Gustavo Malkomes · Roman Garnett · Kilian Weinberger · Dennis Barbour · John Cunningham -
2014 Poster: Sampling for Inference in Probabilistic Models with Fast Bayesian Quadrature »
Tom Gunter · Michael A Osborne · Roman Garnett · Philipp Hennig · Stephen J Roberts -
2013 Poster: Σ-Optimality for Active Learning on Gaussian Random Fields »
Yifei Ma · Roman Garnett · Jeff Schneider