Timezone: »
Predicting molecular properties with data-driven methods has drawn much attention in recent years. Particularly, Graph Neural Networks (GNNs) have demonstrated remarkable success in various molecular generation and prediction tasks. In cases where labeled data is scarce, GNNs can be pre-trained on unlabeled molecular data to first learn the general semantic and structural information before being finetuned for specific tasks. However, most existing self-supervised pretraining frameworks for GNNs only focus on node-level or graph-level tasks. These approaches cannot capture the rich information in subgraphs or graph motifs. For example, functional groups (frequently-occurred subgraphs in molecular graphs) often carry indicative information about the molecular properties. To bridge this gap, we propose Motif-based Graph Self-supervised Learning (MGSSL) by introducing a novel self-supervised motif generation framework for GNNs. First, for motif extraction from molecular graphs, we design a molecule fragmentation method that leverages a retrosynthesis-based algorithm BRICS and additional rules for controlling the size of motif vocabulary. Second, we design a general motif-based generative pretraining framework in which GNNs are asked to make topological and label predictions. This generative framework can be implemented in two different ways, i.e., breadth-first or depth-first. Finally, to take the multi-scale information in molecular graphs into consideration, we introduce a multi-level self-supervised pre-training. Extensive experiments on various downstream benchmark tasks show that our methods outperform all state-of-the-art baselines.
Author Information
ZAIXI ZHANG (University of Science and Technology of China)
Qi Liu (" University of Science and Technology of China, China")
Hao Wang (University of Science and Technology of China, Tsinghua University)
Chengqiang Lu
Chee-Kong Lee (Tencent Quantum Lab)
More from the Same Authors
-
2022 Poster: DARE: Disentanglement-Augmented Rationale Extraction »
Linan Yue · Qi Liu · Yichao Du · Yanqing An · Li Wang · Enhong Chen -
2022 Poster: Hierarchical Graph Transformer with Adaptive Node Sampling »
ZAIXI ZHANG · Qi Liu · Qingyong Hu · Chee-Kong Lee -
2022 Spotlight: Lightning Talks 5B-4 »
Yuezhi Yang · Zeyu Yang · Yong Lin · Yi.shi Xu · Linan Yue · Tao Yang · Weixin Chen · Qi Liu · Jiaqi Chen · Dongsheng Wang · Baoyuan Wu · Yuwang Wang · Hao Pan · Shengyu Zhu · Zhenwei Miao · Yan Lu · Lu Tan · Bo Chen · Yichao Du · Haoqian Wang · Wei Li · Yanqing An · Ruiying Lu · Peng Cui · Nanning Zheng · Li Wang · Zhibin Duan · Xiatian Zhu · Mingyuan Zhou · Enhong Chen · Li Zhang -
2022 Spotlight: DARE: Disentanglement-Augmented Rationale Extraction »
Linan Yue · Qi Liu · Yichao Du · Yanqing An · Li Wang · Enhong Chen -
2022 Spotlight: Hierarchical Graph Transformer with Adaptive Node Sampling »
ZAIXI ZHANG · Qi Liu · Qingyong Hu · Chee-Kong Lee -
2020 Poster: Sampling-Decomposable Generative Adversarial Recommender »
Binbin Jin · Defu Lian · Zheng Liu · Qi Liu · Jianhui Ma · Xing Xie · Enhong Chen