Timezone: »
We present a signal representation framework called the sparse manifold transform that combines key ideas from sparse coding, manifold learning, and slow feature analysis. It turns non-linear transformations in the primary sensory signal space into linear interpolations in a representational embedding space while maintaining approximate invertibility. The sparse manifold transform is an unsupervised and generative framework that explicitly and simultaneously models the sparse discreteness and low-dimensional manifold structure found in natural scenes. When stacked, it also models hierarchical composition. We provide a theoretical description of the transform and demonstrate properties of the learned representation on both synthetic data and natural videos.
Author Information
Yubei Chen (EECS & Mathematics UC Berkeley)
Dylan Paiton (University of California, Berkeley)
Bruno Olshausen (Redwood Center/UC Berkeley)
More from the Same Authors
-
2022 : Neuromorphic Visual Scene Understanding with Resonator Networks (in brief) »
Alpha Renner · Giacomo Indiveri · Lazar Supic · Andreea Danielescu · Bruno Olshausen · Fritz Sommer · Yulia Sandamirskaya · Edward Frady -
2022 : Disentangling Images with Lie Group Transformations and Sparse Coding »
Ho Yin Chau · Frank Qiu · Yubei Chen · Bruno Olshausen -
2022 : Panel Discussion II: Geometric and topological principles for representations in the brain »
Bruno Olshausen · Kristopher Jensen · Gabriel Kreiman · Manu Madhav · Christian A Shewmake -
2022 : In search of invariance in brains and machines »
Bruno Olshausen -
2019 Poster: Superposition of many models into one »
Brian Cheung · Alexander Terekhov · Yubei Chen · Pulkit Agrawal · Bruno Olshausen -
2010 Poster: Group Sparse Coding with a Laplacian Scale Mixture Prior »
Pierre J Garrigues · Bruno Olshausen -
2009 Workshop: Manifolds, sparsity, and structured models: When can low-dimensional geometry really help? »
Richard Baraniuk · Volkan Cevher · Mark A Davenport · Piotr Indyk · Bruno Olshausen · Michael B Wakin -
2009 Poster: Learning transport operators for image manifolds »
Jack Culpepper · Bruno Olshausen -
2008 Poster: Learning Transformational Invariants from Time-Varying Natural Images »
Charles Cadieu · Bruno Olshausen -
2008 Spotlight: Learning Transformational Invariants from Time-Varying Natural Images »
Charles Cadieu · Bruno Olshausen -
2007 Poster: Learning Horizontal Connections in a Sparse Coding Model of Natural Images »
Pierre Garrigues · Bruno Olshausen