Timezone: »
It has been shown that adapting a dictionary of basis functions to the statistics of natural images so as to maximize sparsity in the coefficients results in a set of dictionary elements whose spatial properties resemble those of V1 (primary visual cortex) receptive fields. However, the resulting sparse coefficients still exhibit pronounced statistical dependencies, thus violating the independence assumption of the sparse coding model. Here, we propose a model that attempts to capture the dependencies among the basis function coefficients by including a pairwise coupling term in the prior over the coefficient activity states. When adapted to the statistics of natural images, the coupling terms learn a combination of facilitatory and inhibitory interactions among neighboring basis functions. These learned interactions may offer an explanation for the function of horizontal connections in V1, and we discuss the implications of our findings for physiological experiments.
Author Information
Pierre Garrigues (IQ Engines Inc.)
Bruno Olshausen (Redwood Center/UC Berkeley)
More from the Same Authors
-
2022 : Neuromorphic Visual Scene Understanding with Resonator Networks (in brief) »
Alpha Renner · Giacomo Indiveri · Lazar Supic · Andreea Danielescu · Bruno Olshausen · Fritz Sommer · Yulia Sandamirskaya · Edward Frady -
2022 : Disentangling Images with Lie Group Transformations and Sparse Coding »
Ho Yin Chau · Frank Qiu · Yubei Chen · Bruno Olshausen -
2022 : Panel Discussion II: Geometric and topological principles for representations in the brain »
Bruno Olshausen · Kristopher Jensen · Gabriel Kreiman · Manu Madhav · Christian A Shewmake -
2022 : In search of invariance in brains and machines »
Bruno Olshausen -
2019 Poster: Superposition of many models into one »
Brian Cheung · Alexander Terekhov · Yubei Chen · Pulkit Agrawal · Bruno Olshausen -
2018 Poster: The Sparse Manifold Transform »
Yubei Chen · Dylan Paiton · Bruno Olshausen -
2010 Poster: Group Sparse Coding with a Laplacian Scale Mixture Prior »
Pierre J Garrigues · Bruno Olshausen -
2009 Workshop: Manifolds, sparsity, and structured models: When can low-dimensional geometry really help? »
Richard Baraniuk · Volkan Cevher · Mark A Davenport · Piotr Indyk · Bruno Olshausen · Michael B Wakin -
2009 Poster: Learning transport operators for image manifolds »
Jack Culpepper · Bruno Olshausen -
2008 Poster: Learning Transformational Invariants from Time-Varying Natural Images »
Charles Cadieu · Bruno Olshausen -
2008 Spotlight: Learning Transformational Invariants from Time-Varying Natural Images »
Charles Cadieu · Bruno Olshausen -
2008 Poster: An Homotopy Algorithm for the Lasso with Online Observations »
Pierre Garrigues · Laurent El Ghaoui