Timezone: »

 
Disentangling Images with Lie Group Transformations and Sparse Coding
Ho Yin Chau · Frank Qiu · Yubei Chen · Bruno Olshausen

@
in Symmetry and Geometry in Neural Representations (NeurReps) »
Event URL: https://openreview.net/forum?id=SZEL_mvz7eU »

Discrete spatial patterns and their continuous transformations are two important regularities in natural signals. Lie groups and representation theory are mathematical tools used in previous works to model continuous image transformations. On the other hand, sparse coding is an essential tool for learning dictionaries of discrete natural signal patterns. This paper combines these ideas in a Bayesian generative model that learns to disentangle spatial patterns and their continuous transformations in a completely unsupervised manner. Images are modeled as a sparse superposition of shape components followed by a transformation parameterized by n continuous variables. The shape components and transformations are not predefined but are instead adapted to learn the data’s symmetries. The constraint is that the transformations form a representation of an n-dimensional torus. Training the model on a dataset consisting of controlled geometric transformations of specific MNIST digits shows that it can recover these transformations along with the digits. Training on the full MNIST dataset shows that it can learn the basic digit shapes and the natural transformations such as shearing and stretching contained in this data. This work provides the simplest known Bayesian mathematical model for building unsupervised factorized representations.

Keywords: Disentanglement · sparse coding · Form and Motion · Lie Group Transformations

Author Information

Ho Yin Chau (Columbia University)
Frank Qiu (University of California Berkeley)
Yubei Chen (Data Science, NYU Meta AI (FAIR))
Yubei Chen

I received my bachelor’s degree from the Electrical Engineering department at Tsinghua University, Beijing, in 2012. Then, I joined the EECS department and Berkeley AI Research (BAIR) at UC Berkeley to pursue my Ph.D. study on unsupervised learning and generative models, advised by Professor Bruno Olshausen. Along the way, I received my M.S. degree in EECS and M.A. degree in mathematics at Berkeley. In 2012, I was awarded the NSF GRFP fellowship. In 2019, I got my Ph.D. from the EECS department. In late 2020, I started to work with Yann LeCun at Meta AI (FAIR) and the Center for Data Science at NYU as a postdoctoral scholar, where I continued to work on unsupervised representation learning. I also serve as a reviewer for NeurIPS, ICLR, ICML, AAAI, CVPR, ECCV, Neural Computation, etc.

Bruno Olshausen (Redwood Center/UC Berkeley)

More from the Same Authors