Timezone: »
The process of learning new behaviors over time is a problem of great interest in both neuroscience and artificial intelligence. However, most standard analyses of animal training data either treat behavior as fixed or track only coarse performance statistics (e.g., accuracy, bias), providing limited insight into the evolution of the policies governing behavior. To overcome these limitations, we propose a dynamic psychophysical model that efficiently tracks trial-to-trial changes in behavior over the course of training. Our model consists of a dynamic logistic regression model, parametrized by a set of time-varying weights that express dependence on sensory stimuli as well as task-irrelevant covariates, such as stimulus, choice, and answer history. Our implementation scales to large behavioral datasets, allowing us to infer 500K parameters (e.g. 10 weights over 50K trials) in minutes on a desktop computer. We optimize hyperparameters governing how rapidly each weight evolves over time using the decoupled Laplace approximation, an efficient method for maximizing marginal likelihood in non-conjugate models. To illustrate performance, we apply our method to psychophysical data from both rats and human subjects learning a delayed sensory discrimination task. The model successfully tracks the psychophysical weights of rats over the course of training, capturing day-to-day and trial-to-trial fluctuations that underlie changes in performance, choice bias, and dependencies on task history. Finally, we investigate why rats frequently make mistakes on easy trials, and suggest that apparent lapses can be explained by sub-optimal weighting of known task covariates.
Author Information
Nicholas Roy (Princeton Neuroscience Institute)
Ji Hyun Bak (KIAS)
Athena Akrami (Princeton University)
Carlos Brody (Princeton University)
Jonathan Pillow (Princeton University)
More from the Same Authors
-
2021 : Neural Latents Benchmark ‘21: Evaluating latent variable models of neural population activity »
Felix Pei · Joel Ye · David Zoltowski · Anqi Wu · Raeed Chowdhury · Hansem Sohn · Joseph O'Doherty · Krishna V Shenoy · Matthew Kaufman · Mark Churchland · Mehrdad Jazayeri · Lee Miller · Jonathan Pillow · Il Memming Park · Eva Dyer · Chethan Pandarinath -
2022 : Non-exchangeability in Infinite Switching Linear Dynamical Systems »
Victor Geadah · Jonathan Pillow -
2022 Poster: Dynamic Inverse Reinforcement Learning for Characterizing Animal Behavior »
Zoe Ashwood · Aditi Jha · Jonathan Pillow -
2022 Poster: Extracting computational mechanisms from neural data using low-rank RNNs »
Adrian Valente · Jonathan Pillow · Srdjan Ostojic -
2020 Poster: High-contrast “gaudy” images improve the training of deep neural network models of visual cortex »
Benjamin Cowley · Jonathan Pillow -
2020 Poster: Identifying signal and noise structure in neural population activity with Gaussian process factor models »
Stephen Keeley · Mikio Aoi · Yiyi Yu · Spencer Smith · Jonathan Pillow -
2020 Poster: Inferring learning rules from animal decision-making »
Zoe Ashwood · Nicholas Roy · Ji Hyun Bak · Jonathan Pillow -
2018 Poster: Scaling the Poisson GLM to massive neural datasets through polynomial approximations »
David Zoltowski · Jonathan Pillow -
2018 Poster: Model-based targeted dimensionality reduction for neuronal population data »
Mikio Aoi · Jonathan Pillow -
2018 Poster: Power-law efficient neural codes provide general link between perceptual bias and discriminability »
Michael J Morais · Jonathan Pillow -
2018 Poster: Learning a latent manifold of odor representations from neural responses in piriform cortex »
Anqi Wu · Stan Pashkovski · Sandeep Datta · Jonathan Pillow -
2017 Poster: Gaussian process based nonlinear latent structure discovery in multivariate spike train data »
Anqi Wu · Nicholas Roy · Stephen Keeley · Jonathan Pillow -
2016 Poster: Bayesian latent structure discovery from multi-neuron recordings »
Scott Linderman · Ryan Adams · Jonathan Pillow -
2016 Poster: Adaptive optimal training of animal behavior »
Ji Hyun Bak · Jung Choi · Ilana Witten · Athena Akrami · Jonathan Pillow -
2016 Poster: A Bayesian method for reducing bias in neural representational similarity analysis »
Mingbo Cai · Nicolas W Schuck · Jonathan Pillow · Yael Niv -
2015 Poster: Convolutional spike-triggered covariance analysis for neural subunit models »
Anqi Wu · Il Memming Park · Jonathan Pillow