Timezone: »
We introduce the Locally Linear Latent Variable Model (LL-LVM), a probabilistic model for non-linear manifold discovery that describes a joint distribution over observations, their manifold coordinates and locally linear maps conditioned on a set of neighbourhood relationships. The model allows straightforward variational optimisation of the posterior distribution on coordinates and locally linear maps from the latent space to the observation space given the data. Thus, the LL-LVM encapsulates the local-geometry preserving intuitions that underlie non-probabilistic methods such as locally linear embedding (LLE). Its probabilistic semantics make it easy to evaluate the quality of hypothesised neighbourhood relationships, select the intrinsic dimensionality of the manifold, construct out-of-sample extensions and to combine the manifold model with additional probabilistic models that capture the structure of coordinates within the manifold.
Author Information
Mijung Park (UCL)
Wittawat Jitkrittum (Gatsby Unit, UCL)
Ahmad Qamar
Zoltan Szabo (Gatsby Unit, UCL)
Lars Buesing (DeepMind)
Maneesh Sahani (Gatsby Unit, UCL)
More from the Same Authors
-
2021 Spotlight: Probabilistic Tensor Decomposition of Neural Population Spiking Activity »
Hugo Soulat · Sepiedeh Keshavarzi · Troy Margrie · Maneesh Sahani -
2022 Poster: Structured Recognition for Generative Models with Explaining Away »
Changmin Yu · Hugo Soulat · Neil Burgess · Maneesh Sahani -
2022 Poster: Post-hoc estimators for learning to defer to an expert »
Harikrishna Narasimhan · Wittawat Jitkrittum · Aditya Menon · Ankit Rawat · Sanjiv Kumar -
2021 Poster: Probabilistic Tensor Decomposition of Neural Population Spiking Activity »
Hugo Soulat · Sepiedeh Keshavarzi · Troy Margrie · Maneesh Sahani -
2020 Poster: Non-reversible Gaussian processes for identifying latent dynamical structure in neural data »
Virginia Rutten · Alberto Bernacchia · Maneesh Sahani · Guillaume Hennequin -
2020 Oral: Non-reversible Gaussian processes for identifying latent dynamical structure in neural data »
Virginia Rutten · Alberto Bernacchia · Maneesh Sahani · Guillaume Hennequin -
2020 Poster: Organizing recurrent network dynamics by task-computation to enable continual learning »
Lea Duncker · Laura N Driscoll · Krishna V Shenoy · Maneesh Sahani · David Sussillo -
2020 Poster: Learning Kernel Tests Without Data Splitting »
Jonas Kübler · Wittawat Jitkrittum · Bernhard Schölkopf · Krikamol Muandet -
2019 Poster: A neurally plausible model for online recognition and postdiction in a dynamical environment »
Li Kevin Wenliang · Maneesh Sahani -
2019 Poster: A neurally plausible model learns successor representations in partially observable environments »
Eszter Vértes · Maneesh Sahani -
2019 Oral: A neurally plausible model learns successor representations in partially observable environments »
Eszter Vértes · Maneesh Sahani -
2019 Poster: Kernel Instrumental Variable Regression »
Rahul Singh · Maneesh Sahani · Arthur Gretton -
2019 Poster: Kernel Stein Tests for Multiple Model Comparison »
Jen Ning Lim · Makoto Yamada · Bernhard Schölkopf · Wittawat Jitkrittum -
2019 Poster: Fisher Efficient Inference of Intractable Models »
Song Liu · Takafumi Kanamori · Wittawat Jitkrittum · Yu Chen -
2019 Oral: Kernel Instrumental Variable Regression »
Rahul Singh · Maneesh Sahani · Arthur Gretton -
2019 Tutorial: Interpretable Comparison of Distributions and Models »
Wittawat Jitkrittum · Danica J. Sutherland · Arthur Gretton -
2018 Poster: Informative Features for Model Comparison »
Wittawat Jitkrittum · Heishiro Kanagawa · Patsorn Sangkloy · James Hays · Bernhard Schölkopf · Arthur Gretton -
2018 Poster: Flexible and accurate inference and learning for deep generative models »
Eszter Vértes · Maneesh Sahani -
2018 Poster: Temporal alignment and latent Gaussian process factor inference in population spike trains »
Lea Duncker · Maneesh Sahani -
2017 : A Linear-Time Kernel Goodness-of-Fit Test (NIPS best paper) »
Wittawat Jitkrittum -
2017 Spotlight: Fast amortized inference of neural activity from calcium imaging data with variational autoencoders »
Artur Speiser · Jinyao Yan · Evan Archer · Lars Buesing · Srinivas C Turaga · Jakob H Macke -
2017 Poster: Fast amortized inference of neural activity from calcium imaging data with variational autoencoders »
Artur Speiser · Jinyao Yan · Evan Archer · Lars Buesing · Srinivas C Turaga · Jakob H Macke -
2017 Poster: Imagination-Augmented Agents for Deep Reinforcement Learning »
Sébastien Racanière · Theophane Weber · David Reichert · Lars Buesing · Arthur Guez · Danilo Jimenez Rezende · Adrià Puigdomènech Badia · Oriol Vinyals · Nicolas Heess · Yujia Li · Razvan Pascanu · Peter Battaglia · Demis Hassabis · David Silver · Daan Wierstra -
2017 Oral: Imagination-Augmented Agents for Deep Reinforcement Learning »
Sébastien Racanière · Theophane Weber · David Reichert · Lars Buesing · Arthur Guez · Danilo Jimenez Rezende · Adrià Puigdomènech Badia · Oriol Vinyals · Nicolas Heess · Yujia Li · Razvan Pascanu · Peter Battaglia · Demis Hassabis · David Silver · Daan Wierstra -
2017 Poster: A Linear-Time Kernel Goodness-of-Fit Test »
Wittawat Jitkrittum · Wenkai Xu · Zoltan Szabo · Kenji Fukumizu · Arthur Gretton -
2017 Oral: A Linear-Time Kernel Goodness-of-Fit Test »
Wittawat Jitkrittum · Wenkai Xu · Zoltan Szabo · Kenji Fukumizu · Arthur Gretton -
2016 Oral: Interpretable Distribution Features with Maximum Testing Power »
Wittawat Jitkrittum · Zoltán Szabó · Kacper P Chwialkowski · Arthur Gretton -
2016 Poster: Interpretable Distribution Features with Maximum Testing Power »
Wittawat Jitkrittum · Zoltán Szabó · Kacper P Chwialkowski · Arthur Gretton -
2015 Poster: Gradient-free Hamiltonian Monte Carlo with Efficient Kernel Exponential Families »
Heiko Strathmann · Dino Sejdinovic · Samuel Livingstone · Zoltan Szabo · Arthur Gretton -
2015 Poster: Unlocking neural population non-stationarities using hierarchical dynamics models »
Mijung Park · Gergo Bohner · Jakob H Macke -
2015 Poster: Optimal Rates for Random Fourier Features »
Bharath Sriperumbudur · Zoltan Szabo -
2015 Spotlight: Optimal Rates for Random Fourier Features »
Bharath Sriperumbudur · Zoltan Szabo -
2014 Poster: Sparse Bayesian structure learning with dependent relevance determination prior »
Anqi Wu · Mijung Park · Sanmi Koyejo · Jonathan W Pillow -
2013 Workshop: Acquiring and Analyzing the Activity of Large Neural Ensembles »
Srinivas C Turaga · Lars Buesing · Maneesh Sahani · Jakob H Macke -
2013 Poster: Extracting regions of interest from biological images with convolutional sparse block coding »
Marius Pachitariu · Adam M Packer · Noah Pettit · Henry Dalgleish · Michael Hausser · Maneesh Sahani -
2013 Poster: Recurrent linear models of simultaneously-recorded neural populations »
Marius Pachitariu · Biljana Petreska · Maneesh Sahani -
2013 Spotlight: Recurrent linear models of simultaneously-recorded neural populations »
Marius Pachitariu · Biljana Petreska · Maneesh Sahani -
2012 Poster: Spectral learning of linear dynamics from generalised-linear observations with application to neural population data »
Lars Buesing · Jakob H Macke · Maneesh Sahani -
2012 Oral: Spectral learning of linear dynamics from generalised-linear observations with application to neural population data »
Lars Buesing · Jakob H Macke · Maneesh Sahani -
2012 Poster: Learning visual motion in recurrent neural networks »
Marius Pachitariu · Maneesh Sahani -
2011 Oral: Empirical models of spiking in neural populations »
Jakob H Macke · Lars Buesing · John P Cunningham · Byron M Yu · Krishna V Shenoy · Maneesh Sahani -
2011 Poster: Empirical models of spiking in neural populations »
Jakob H Macke · Lars Buesing · John P Cunningham · Byron M Yu · Krishna V Shenoy · Maneesh Sahani -
2011 Poster: Dynamical segmentation of single trials from population neural data »
Biljana Petreska · Byron M Yu · John P Cunningham · Gopal Santhanam · Stephen I Ryu · Krishna V Shenoy · Maneesh Sahani -
2011 Poster: Probabilistic amplitude and frequency demodulation »
Richard Turner · Maneesh Sahani -
2011 Spotlight: Probabilistic amplitude and frequency demodulation »
Richard Turner · Maneesh Sahani -
2010 Session: The Sam Roweis Symposium »
Maneesh Sahani -
2009 Poster: Occlusive Components Analysis »
Jörg Lücke · Richard Turner · Maneesh Sahani · Marc Henniges -
2008 Poster: Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity »
Byron M Yu · John P Cunningham · Gopal Santhanam · Stephen I Ryu · Krishna V Shenoy · Maneesh Sahani -
2007 Workshop: Beyond Simple Cells: Probabilistic Models for Visual Cortical Processing »
Richard Turner · Pietro Berkes · Maneesh Sahani -
2007 Oral: Inferring Elapsed Time from Stochastic Neural Processes »
Misha B Ahrens · Maneesh Sahani -
2007 Spotlight: Inferring Neural Firing Rates from Spike Trains Using Gaussian Processes »
John P Cunningham · Byron M Yu · Krishna V Shenoy · Maneesh Sahani -
2007 Poster: Inferring Neural Firing Rates from Spike Trains Using Gaussian Processes »
John P Cunningham · Byron M Yu · Krishna V Shenoy · Maneesh Sahani -
2007 Poster: Inferring Elapsed Time from Stochastic Neural Processes »
Misha B Ahrens · Maneesh Sahani -
2007 Poster: Modeling Natural Sounds with Modulation Cascade Processes »
Richard Turner · Maneesh Sahani -
2007 Poster: On Sparsity and Overcompleteness in Image Models »
Pietro Berkes · Richard Turner · Maneesh Sahani