Timezone: »

 
Spotlight
A flow-based latent state generative model of neural population responses to natural images
Mohammad Bashiri · Edgar Walker · Konstantin-Klemens Lurz · Akshay Jagadish · Taliah Muhammad · Zhiwei Ding · Zhuokun Ding · Andreas Tolias · Fabian Sinz

@

We present a joint deep neural system identification model for two major sources of neural variability: stimulus-driven and stimulus-conditioned fluctuations. To this end, we combine (1) state-of-the-art deep networks for stimulus-driven activity and (2) a flexible, normalizing flow-based generative model to capture the stimulus-conditioned variability including noise correlations. This allows us to train the model end-to-end without the need for sophisticated probabilistic approximations associated with many latent state models for stimulus-conditioned fluctuations. We train the model on the responses of thousands of neurons from multiple areas of the mouse visual cortex to natural images. We show that our model outperforms previous state-of-the-art models in predicting the distribution of neural population responses to novel stimuli, including shared stimulus-conditioned variability. Furthermore, it successfully learns known latent factors of the population responses that are related to behavioral variables such as pupil dilation, and other factors that vary systematically with brain area or retinotopic location. Overall, our model accurately accounts for two critical sources of neural variability while avoiding several complexities associated with many existing latent state models. It thus provides a useful tool for uncovering the interplay between different factors that contribute to variability in neural activity.

Author Information

Mohammad Bashiri (University of Tuebingen)
Edgar Walker (Baylor College of Medicine)
Konstantin-Klemens Lurz (University of Tuebingen)
Akshay Jagadish (University of Tuebingen)
Taliah Muhammad (Baylor College of Medicine)
Zhiwei Ding (Baylor College of Medicine)
Zhuokun Ding (Baylor College of Medicine)
Andreas Tolias (Baylor College of Medicine)
Fabian Sinz (University Tübingen)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors