Skip to yearly menu bar Skip to main content

Workshop

Associative Memory & Hopfield Networks in 2023

Parikshit Ram · Hilde Kuehne · Daniel Lee · Cengiz Pehlevan · Mohammed Zaki · Lenka Zdeborová

Project Page

Abstract

This workshop will discuss the latest multidisciplinary developments in Associative Memory and Hopfield Networks. A number of leading researchers in this research area from around the world have already agreed to attend and present their latest results. We anticipate sharing their presentations and outlining future research directions in this emerging field with the rest of the NeurIPS community.

Tagline: We will discuss recent multidisciplinary developments in Hopfield Networks and outline future research directions in this emerging field.

Video

Chat is not available.

Schedule

Timezone: America/Los_Angeles

6:15 AM

Opening Remarks Opening

Mohammed Zaki

Video

6:25 AM

Introductory words on Hopfield Networks Invited Talk

John J. Hopfield

Video

6:40 AM

Trading off pattern number and richness: A new associative memory model based on pre-structured low-dimensional manifolds that saturates the information bound regardless of number of memories Invited Talk

Ila Fiete

Video

7:15 AM

Dense Associative Memory for Novel Transformer Architectures Invited Talk

Dmitry Krotov

Video

7:50 AM

Rapid Learning without Catastrophic Forgetting in the Morris Water Maze Oral

Raymond Wang · Jaedong Hwang · Akhilan Boopathy · Ila Fiete

Video

8:00 AM

Coffee Break

8:30 AM

Sequential Learning and Retrieval in a Sparse Distributed Memory: The K-winner Modern Hopfield Network Oral

Shaunak Bhandarkar · James McClelland

Video

8:40 AM

In search of dispersed memories: Generative diffusion models are associative memory networks Oral

Luca Ambrogioni

Video

8:50 AM

Memory Architectures for Deep Learning Invited Talk

Sepp Hochreiter

Video

9:25 AM

The Exponential Capacity of Dense Associative Memories Invited Talk

Carlo Lucibello

Video

10:00 AM

Lunch Break

11:30 AM

Transformers as the Associative Memory Machines Invited Talk

Krzysztof Choromanski

Video

12:05 PM

Hopfield Networks meet Software Engineering Panel Discussion

Blaise Aguera y Arcas · Olawale Onabola · Bao Pham · Benjamin Hoover · Hendrik Strobelt

Video

1:00 PM

Coffee Break

1:30 PM

Hopfield Boosting for Out-of-Distribution Detection Oral

Claus Hofmann · Simon Schmid · Bernhard Lehner · Daniel Klotz · Sepp Hochreiter

Video

1:40 PM

Long Sequence Hopfield Memory Oral

Hamza Chaudhry · Jacob Zavatone-Veth · Dmitry Krotov · Cengiz Pehlevan

Video

1:50 PM

Associative Transformer Is A Sparse Representation Learner Oral

Yuwei Sun · Hideya Ochiai · Zhirong Wu · Stephen Lin · Ryota Kanai

Video

2:00 PM

Retrieving $k$-Nearest Memories with Modern Hopfield Networks Oral

Alexander Davydov · Sean Jaffe · Ambuj K Singh · Francesco Bullo

Video

2:10 PM

Poster Session In-person Poster Session

3:25 PM

Closing Remarks Conclusion

Parikshit Ram

Video

Sparse Modern Hopfield Networks Poster

André Martins · Vlad Niculae · Daniel McNamee

Controlling the bifurcations of attractors in modern Hopfield networks Poster

Maria Yampolskaya · Pankaj Mehta

Associative Transformer Is A Sparse Representation Learner Poster

Yuwei Sun · Hideya Ochiai · Zhirong Wu · Stephen Lin · Ryota Kanai

Long Sequence Hopfield Memory Poster

Hamza Chaudhry · Jacob Zavatone-Veth · Dmitry Krotov · Cengiz Pehlevan

Training a Hopfield Variational Autoencoder with Equilibrium Propagation Poster

Tom Van Der Meersch · Johannes Deleu · Thomas Demeester

In-Context Exemplars as Clues to Retrieving from Large Associative Memory Poster

Jiachen Zhao

Enhanced cue associated memory in temporally consistent recurrent neural networks Poster

Udith Haputhanthri · Liam Storan · Adam Shai · Surya Ganguli · Mark Schnitzer · Hidenori Tanaka · Fatih Dinc

Learning Sequence Attractors in Recurrent Networks with Hidden Neurons Poster

Yao Lu · Si Wu

Associative Memory Under the Probabilistic Lens: Improved Transformers & Dynamic Memory Creation Poster

Rylan Schaeffer · Mikail Khona · Nika Zahedi · Ila Fiete · Andrey Gromov · Sanmi Koyejo

In search of dispersed memories: Generative diffusion models are associative memory networks Poster

Luca Ambrogioni

Memorization and consolidation in associative memory networks Poster

Danil Tyulmankov · Kimberly Stachenfeld · Dmitry Krotov · L F Abbott

Modeling Recognition Memory with Predictive Coding and Hopfield Networks Poster

Tianjin Li · Mufeng Tang · Rafal Bogacz

Associative Memories with Heavy-Tailed Data Poster

Vivien Cabannes · Elvis Dohmatob · Alberto Bietti

Inverse distance weighting attention Poster

Calvin McCarter

Modern Hopfield Networks as Memory for Iterative Learning on Tabular Data Poster

Bernhard Schäfl · Lukas Gruber · Angela Bitto · Sepp Hochreiter

Random Feature Hopfield Networks generalize retrieval to previously unseen examples Poster

Matteo Negri · Clarissa Lauditi · Gabriele Perugini · Carlo Lucibello · Enrico Malatesta

Retrieving $k$-Nearest Memories with Modern Hopfield Networks Poster

Alexander Davydov · Sean Jaffe · Ambuj K Singh · Francesco Bullo

A Different Route to Exponential Storage Capacity Poster

Elvis Dohmatob

Variable Memory: Beyond the Fixed Memory Assumption in Memory Modeling Poster

Arjun Karuvally · Hava Siegelmann

Biologically-inspired adaptive learning in the Hopfield-network based self-optimization model Poster

Aisha Belhadi

How Robust Are Energy-Based Models Trained With Equilibrium Propagation? Poster

Siddharth Mansingh · Michal Kucer · Garrett Kenyon · Juston Moore · Michael Teti

Accelerating Hierarchical Associative Memory: A Deep Equilibrium Approach Poster

Cédric Goemaere · Johannes Deleu · Thomas Demeester

Sequential Learning and Retrieval in a Sparse Distributed Memory: The K-winner Modern Hopfield Network Poster

Shaunak Bhandarkar · James McClelland

Energy Transformer Poster

Benjamin Hoover · Yuchen Liang · Bao Pham · Rameswar Panda · Hendrik Strobelt · Duen Horng Chau · Mohammed Zaki · Dmitry Krotov

Modulating interactions to control dynamics of neural networks Poster

Lukas Herron · Pablo Sartori · BingKan Xue

Generalizable Relational Inference with Cognitive Maps in a Hippocampal Model and in Primates Poster

Jaedong Hwang · Sujaya Neupane · Mehrdad Jazayeri · Ila Fiete

Modern Hopfield Network with Local Learning Rules for Class Generalization Poster

Shruti Joshi · Giri Prashanth · Maksim Bazhenov

Rapid Learning without Catastrophic Forgetting in the Morris Water Maze Poster

Raymond Wang · Jaedong Hwang · Akhilan Boopathy · Ila Fiete

Multidimensional Hopfield Networks for clustering Poster

Gergely Stomfai · Łukasz Sienkiewicz · Barbara Rychalska

Statistics-guided Associative Memories Poster

Hongzhi Wang · Satyananda Kashyap · Niharika DSouza · Tanveer Syeda-Mahmood

Daydreaming Hopfield Networks and their surprising effectiveness on correlated data Poster

Ludovica Serricchio · Claudio Chilin · Dario Bocchi · Raffaele Marino · Matteo Negri · Chiara Cammarota · Federico Ricci-Tersenghi

Hopfield Boosting for Out-of-Distribution Detection Poster

Claus Hofmann · Simon Schmid · Bernhard Lehner · Daniel Klotz · Sepp Hochreiter

Saliency-Guided Hidden Associative Replay for Continual Learning Poster

Guangji Bai · Qilong Zhao · Xiaoyang Jiang · Liang Zhao

Skip Connections Increase the Capacity of Associative Memories in Variable Binding Mechanisms Poster

Yi Xie · Yichen Li · Akshay Rangamani

Minimum Description Length Hopfield Networks Poster

Matan Abudy · Nur Lan · Emmanuel Chemla · Roni Katzir

Memory in Plain Sight: A Survey of the Uncanny Resemblances between Diffusion Models and Associative Memories Poster

Benjamin Hoover · Hendrik Strobelt · Dmitry Krotov · Judy Hoffman · Zsolt Kira · Duen Horng Chau

Exploring the Temperature-Dependent Phase Transition in Modern Hopfield Networks Poster

Felix Koulischer · Cédric Goemaere · Tom Van Der Meersch · Johannes Deleu · Thomas Demeester

Probabilistic Forecasting via Modern Hopfield Networks Poster

Kashif Rasul · Pablo Vicente · Anderson Schneider · Alexander März

Error-correcting columnar networks: high-capacity memory under sparse connectivity Poster

Haozhe Shan · Ludovica Bachschmid-Romano · Haim Sompolinsky

Hopfield-Enhanced Deep Neural Networks for Artifact-Resilient Brain State Decoding Poster

Arnau Marin-Llobet · Arnau Manasanch · Mavi Sanchez-Vives