Timezone: »
Understanding how the brain constructs statistical models of the sensory world remains a longstanding challenge for computational neuroscience. Here, we derive an unsupervised local synaptic plasticity rule that trains neural circuits to infer latent structure from sensory stimuli via a novel loss function for approximate online Bayesian inference. The learning algorithm is driven by a local error signal computed between two factors that jointly contribute to neural activity: stimulus drive and internal predictions --- the network's 'impression' of the stimulus. Physiologically, we associate these two components with the basal and apical dendrites of pyramidal neurons, respectively. We show that learning can be implemented online, is capable of capturing temporal dependencies in continuous input streams, and generalizes to hierarchical architectures. Furthermore, we demonstrate both analytically and empirically that the algorithm is more data-efficient than a three-factor plasticity alternative, enabling it to learn statistics of high-dimensional, naturalistic inputs. Overall, the model provides a bridge from mechanistic accounts of synaptic plasticity to algorithmic descriptions of unsupervised probabilistic learning and inference.
Author Information
Colin Bredenberg (New York University)
Benjamin Lyo (New York University)
Eero Simoncelli (FlatIron Institute / New York University)
Eero P. Simoncelli received the B.S. degree in Physics in 1984 from Harvard University, studied applied mathematics at Cambridge University for a year and a half, and then received the M.S. degree in 1988 and the Ph.D. degree in 1993, both in Electrical Engineering from the Massachusetts Institute of Technology. He was an Assistant Professor in the Computer and Information Science department at the University of Pennsylvania from 1993 until 1996. He moved to New York University in September of 1996, where he is currently a Professor in Neural Science, Mathematics, and Psychology. In August 2000, he became an Associate Investigator of the Howard Hughes Medical Institute, under their new program in Computational Biology. In Fall 2020, he resigned his HHMI appointment to become the scientific director of the Center for Computational Neuroscience at the Flatiron Institute, of the Simons Foundation. His research interests span a wide range of topics in the representation and analysis of visual images, in both machine and biological systems.
Cristina Savin (NYU)
More from the Same Authors
-
2021 Spotlight: A sampling-based circuit for optimal decision making »
Camille Rullán Buxó · Cristina Savin -
2021 Spotlight: Across-animal odor decoding by probabilistic manifold alignment »
Pedro Herrero-Vidal · Dmitry Rinberg · Cristina Savin -
2022 : Fine-tuning hierarchical circuits through learned stochastic co-modulation »
Caroline Haimerl · Eero Simoncelli · Cristina Savin -
2022 : Fine-tuning hierarchical circuits through learned stochastic co-modulation »
Caroline Haimerl · Eero Simoncelli · Cristina Savin -
2022 Poster: Maximum a posteriori natural scene reconstruction from retinal ganglion cells with deep denoiser priors »
Eric Wu · Nora Brackbill · Alexander Sher · Alan Litke · Eero Simoncelli · E.J. Chichilnisky -
2021 Poster: Adaptive Denoising via GainTuning »
Sreyas Mohan · Joshua L Vincent · Ramon Manzorro · Peter Crozier · Carlos Fernandez-Granda · Eero Simoncelli -
2021 Poster: Stochastic Solutions for Linear Inverse Problems using the Prior Implicit in a Denoiser »
Zahra Kadkhodaie · Eero Simoncelli -
2021 Poster: A sampling-based circuit for optimal decision making »
Camille Rullán Buxó · Cristina Savin -
2021 Poster: Across-animal odor decoding by probabilistic manifold alignment »
Pedro Herrero-Vidal · Dmitry Rinberg · Cristina Savin -
2020 : Panel discussion 2 »
Danielle S Bassett · Yoshua Bengio · Cristina Savin · David Duvenaud · Anna Choromanska · Yanping Huang -
2020 : Invited Talk Cristina Savin »
Cristina Savin -
2020 Poster: Learning efficient task-dependent representations with synaptic plasticity »
Colin Bredenberg · Eero Simoncelli · Cristina Savin -
2019 : Invited Talk: Computing and learning in the presence of neural noise »
Cristina Savin -
2019 : Local gain control and perceptual invariances »
Eero Simoncelli -
2019 : Poster Session »
Jonathan Scarlett · Piotr Indyk · Ali Vakilian · Adrian Weller · Partha P Mitra · Benjamin Aubin · Bruno Loureiro · Florent Krzakala · Lenka Zdeborová · Kristina Monakhova · Joshua Yurtsever · Laura Waller · Hendrik Sommerhoff · Michael Moeller · Rushil Anirudh · Shuang Qiu · Xiaohan Wei · Zhuoran Yang · Jayaraman Thiagarajan · Salman Asif · Michael Gillhofer · Johannes Brandstetter · Sepp Hochreiter · Felix Petersen · Dhruv Patel · Assad Oberai · Akshay Kamath · Sushrut Karmalkar · Eric Price · Ali Ahmed · Zahra Kadkhodaie · Sreyas Mohan · Eero Simoncelli · Carlos Fernandez-Granda · Oscar Leong · Wesam Sakla · Rebecca Willett · Stephan Hoyer · Jascha Sohl-Dickstein · Sam Greydanus · Gauri Jagatap · Chinmay Hegde · Michael Kellman · Jonathan Tamir · Nouamane Laanait · Ousmane Dia · Mirco Ravanelli · Jonathan Binas · Negar Rostamzadeh · Shirin Jalali · Tiantian Fang · Alex Schwing · Sébastien Lachapelle · Philippe Brouillard · Tristan Deleu · Simon Lacoste-Julien · Stella Yu · Arya Mazumdar · Ankit Singh Rawat · Yue Zhao · Jianshu Chen · Xiaoyang Li · Hubert Ramsauer · Gabrio Rizzuti · Nikolaos Mitsakos · Dingzhou Cao · Thomas Strohmer · Yang Li · Pei Peng · Gregory Ongie -
2019 : Coffee Break & Poster Session »
Samia Mohinta · Andrea Agostinelli · Alexandra Moringen · Jee Hang Lee · Yat Long Lo · Wolfgang Maass · Blue Sheffer · Colin Bredenberg · Benjamin Eysenbach · Liyu Xia · Efstratios Markou · Jan Lichtenberg · Pierre Richemond · Tony Zhang · JB Lanier · Baihan Lin · William Fedus · Glen Berseth · Marta Sarrico · Matthew Crosby · Stephen McAleer · Sina Ghiassian · Franz Scherr · Guillaume Bellec · Darjan Salaj · Arinbjörn Kolbeinsson · Matthew Rosenberg · Jaehoon Shin · Sang Wan Lee · Guillermo Cecchi · Irina Rish · Elias Hajek -
2019 Poster: Flexible information routing in neural populations through stochastic comodulation »
Caroline Haimerl · Cristina Savin · Eero Simoncelli -
2017 Poster: Eigen-Distortions of Hierarchical Representations »
Alexander Berardino · Valero Laparra · Johannes Ballé · Eero Simoncelli -
2017 Oral: Eigen-Distortions of Hierarchical Representations »
Alexander Berardino · Valero Laparra · Johannes Ballé · Eero Simoncelli -
2012 Poster: Efficient and direct estimation of a neural subunit model for sensory coding »
Brett Vintch · Andrew Zaharia · J Movshon · Eero Simoncelli -
2012 Poster: Hierarchical spike coding of sound »
yan karklin · Chaitanya Ekanadham · Eero Simoncelli -
2012 Spotlight: Hierarchical spike coding of sound »
yan karklin · Chaitanya Ekanadham · Eero Simoncelli -
2011 Poster: Efficient coding with a population of Linear-Nonlinear neurons »
yan karklin · Eero Simoncelli -
2011 Poster: A blind sparse deconvolution method for neural spike identification »
Chaitanya Ekanadham · Daniel Tranchina · Eero Simoncelli -
2011 Spotlight: A blind sparse deconvolution method for neural spike identification »
Chaitanya Ekanadham · Daniel Tranchina · Eero Simoncelli -
2010 Poster: Implicit encoding of prior probabilities in optimal neural populations »
Deep Ganguli · Eero Simoncelli -
2009 Poster: Hierarchical Modeling of Local Image Features through $L_p$-Nested Symmetric Distributions »
Fabian H Sinz · Eero Simoncelli · Matthias Bethge -
2008 Oral: Reducing statistical dependencies in natural signals using radial Gaussianization »
Siwei Lyu · Eero Simoncelli -
2008 Poster: Reducing statistical dependencies in natural signals using radial Gaussianization »
Siwei Lyu · Eero Simoncelli -
2008 Tutorial: Statistical Models of Visual Images »
Eero Simoncelli -
2007 Poster: A Bayesian Model of Conditioned Perception »
Alan A Stocker · Eero Simoncelli -
2006 Poster: Statistical Modeling of Images with Fields of Gaussian Scale Mixtures »
Siwei Lyu · Eero Simoncelli -
2006 Poster: Learning to be Bayesian without Supervision »
Martin Raphan · Eero Simoncelli