Timezone: »
Cache-memory gated graph neural networks
Guixiang Ma · Vy Vo · Nesreen K. Ahmed · Theodore Willke
Event URL: https://openreview.net/forum?id=EDheExoQuJN »
While graph neural networks (GNNs) provide a powerful way to learn structured representations, it remains challenging to learn long-range dependencies between graph nodes. Recurrent gated GNNs only partly address this problem. We introduce a memory augmentation to a gated GNN which simply stores the previous hidden states in a cache. We show that the cache-memory gated GNN outperforms other models on a synthetic task that requires long-range information, as well as tasks on real-world datasets.
Author Information
Guixiang Ma (Intel Labs)
Vy Vo (Intel Corporation)
Nesreen K. Ahmed (Intel Labs)
Theodore Willke (Intel Corporation)
More from the Same Authors
-
2022 : Memory in humans and deep language models: Linking hypotheses for model augmentation »
Omri Raccah · Phoebe Chen · Theodore Willke · David Poeppel · Vy Vo -
2022 Workshop: Memory in Artificial and Real Intelligence (MemARI) »
Mariya Toneva · Javier Turek · Vy Vo · Shailee Jain · Kenneth Norman · Alexander Huth · Uri Hasson · Mihai Capotă -
2022 : Opening remarks »
Vy Vo -
2021 Poster: Low-dimensional Structure in the Space of Language Representations is Reflected in Brain Responses »
Richard Antonello · Javier Turek · Vy Vo · Alexander Huth -
2020 Poster: Interpretable multi-timescale models for predicting fMRI responses to continuous natural speech »
Shailee Jain · Vy Vo · Shivangi Mahto · Amanda LeBel · Javier Turek · Alexander Huth -
2020 Poster: Adaptive Shrinkage Estimation for Streaming Graphs »
Nesreen K. Ahmed · Nick Duffield -
2019 : Panel Discussion »
Theodore Willke · Evelina Fedorenko · Kenton Lee · Paul Smolensky -
2017 : Coffee break and Poster Session II »
Mohamed Kane · Albert Haque · Vagelis Papalexakis · John Guibas · Peter Li · Carlos Arias · Eric Nalisnick · Padhraic Smyth · Frank Rudzicz · Xia Zhu · Theodore Willke · Noemie Elhadad · Hans Raffauf · Harini Suresh · Paroma Varma · Yisong Yue · Ognjen (Oggi) Rudovic · Luca Foschini · Syed Rameel Ahmad · Hasham ul Haq · Valerio Maggio · Giuseppe Jurman · Sonali Parbhoo · Pouya Bashivan · Jyoti Islam · Mirco Musolesi · Chris Wu · Alexander Ratner · Jared Dunnmon · Cristóbal Esteban · Aram Galstyan · Greg Ver Steeg · Hrant Khachatrian · Marc Górriz · Mihaela van der Schaar · Anton Nemchenko · Manasi Patwardhan · Tanay Tandon