Timezone: »
In a variety of behavioral tasks, subjects exhibit an automatic and apparently sub-optimal sequential effect: they respond more rapidly and accurately to a stimulus if it reinforces a local pattern in stimulus history, such as a string of repetitions or alternations, compared to when it violates such a pattern. This is often the case even if the local trends arise by chance in the context of a randomized design, such that stimulus history has no predictive power. In this work, we use a normative Bayesian framework to examine the hypothesis that such idiosyncrasies may reflect the inadvertent engagement of fundamental mechanisms critical for adapting to changing statistics in the natural environment. We show that prior belief in non-stationarity can induce experimentally observed sequential effects in an otherwise Bayes-optimal algorithm. The Bayesian algorithm is shown to be well approximated by linear-exponential filtering of past observations, a feature also apparent in the behavioral data. We derive an explicit relationship between the parameters and computations of the exact Bayesian algorithm and those of the approximate linear-exponential filter. Since the latter is equivalent to a leaky-integration process, a commonly used model of neuronal dynamics underlying perceptual decision-making and trial-to-trial dependencies, our model provides a principled account of why such dynamics are useful. We also show that near-optimal tuning of the leaky-integration process is possible, using stochastic gradient descent based only on the noisy binary inputs. This is a proof of concept that not only can neurons implement near-optimal prediction based on standard neuronal dynamics, but that they can also learn to tune the processing parameters without explicitly representing probabilities.
Author Information
Angela Yu (UC San Diego)
Jonathan D Cohen (Princeton University)
Related Events (a corresponding poster, oral, or spotlight)
-
2008 Spotlight: Sequential effects: Superstition or rational behavior? »
Wed. Dec 10th 01:30 -- 01:31 AM Room
More from the Same Authors
-
2022 : When to choose: The role of information seeking in the speed-accuracy tradeoff »
Javier Alejandro MasÃs Obando · David Melnikoff · Lisa Feldman Barrett · Jonathan D Cohen -
2022 Poster: Using natural language and program abstractions to instill human inductive biases in machines »
Sreejan Kumar · Carlos G. Correa · Ishita Dasgupta · Raja Marjieh · Michael Y Hu · Robert Hawkins · Jonathan D Cohen · nathaniel daw · Karthik Narasimhan · Tom Griffiths -
2021 : Panel I: Human decisions »
Jennifer Trueblood · Alex Peysakhovich · Angela Yu · Ori Plonsky · Tal Yarkoni · Daniel Bjorkegren -
2019 : Panel Discussion led by Grace Lindsay »
Grace Lindsay · Blake Richards · Doina Precup · Jacqueline Gottlieb · Jeff Clune · Jane Wang · Richard Sutton · Angela Yu · Ida Momennejad -
2019 : Invited Talk #6: Features or Bugs: Synergistic Idiosyncrasies in Human Learning and Decision-Making »
Angela Yu -
2018 Poster: Why so gloomy? A Bayesian explanation of human pessimism bias in the multi-armed bandit task »
Dalin Guo · Angela Yu -
2018 Poster: Demystifying excessively volatile human learning: A Bayesian persistent prior and a neural approximation »
Chaitanya Ryali · Gautam Reddy · Angela Yu -
2018 Poster: Beauty-in-averageness and its contextual modulations: A Bayesian statistical account »
Chaitanya Ryali · Angela Yu -
2017 : Computational modeling of human face processing »
Angela Yu -
2017 : Workshop overview »
Michael Mozer · Angela Yu · Brenden Lake -
2017 Workshop: Cognitively Informed Artificial Intelligence: Insights From Natural Intelligence »
Michael Mozer · Brenden Lake · Angela Yu -
2017 Poster: A graph-theoretic approach to multitasking »
Noga Alon · Daniel Reichman · Igor Shinkar · Tal Wagner · Sebastian Musslick · Jonathan D Cohen · Tom Griffiths · Biswadip dey · Kayhan Ozcimder -
2017 Oral: A graph-theoretic approach to multitasking »
Noga Alon · Daniel Reichman · Igor Shinkar · Tal Wagner · Sebastian Musslick · Jonathan D Cohen · Tom Griffiths · Biswadip dey · Kayhan Ozcimder -
2015 Poster: A Theory of Decision Making Under Dynamic Context »
Michael Shvartsman · Vaibhav Srivastava · Jonathan D Cohen -
2013 Poster: Forgetful Bayes and myopic planning: Human learning and decision-making in a bandit setting »
Shunan Zhang · Angela Yu -
2013 Poster: Context-sensitive active sensing in humans »
Sheeraz Ahmad · He Huang · Angela Yu -
2012 Poster: Strategic Impatience in Go/NoGo versus Forced-Choice Decision-Making »
Pradeep Shenoy · Angela Yu -
2012 Oral: Strategic Impatience in Go/NoGo versus Forced-Choice Decision-Making »
Pradeep Shenoy · Angela Yu -
2010 Oral: A rational decision making framework for inhibitory control »
Pradeep Shenoy · Rajesh PN Rao · Angela Yu -
2010 Poster: A rational decision making framework for inhibitory control »
Pradeep Shenoy · Rajesh PN Rao · Angela Yu -
2008 Poster: Learning to Use Working Memory in Partially Observable Environments through Dopaminergic Reinforcement »
Michael Todd · Yael Niv · Jonathan D Cohen -
2008 Oral: Learning to Use Working Memory in Partially Observable Environments through Dopaminergic Reinforcement »
Michael Todd · Yael Niv · Jonathan D Cohen -
2007 Spotlight: Sequential Hypothesis Testing under Stochastic Deadlines »
Peter Frazier · Angela Yu -
2007 Poster: Sequential Hypothesis Testing under Stochastic Deadlines »
Peter Frazier · Angela Yu -
2006 Poster: Optimal Change-Detection and Spiking Neurons »
Angela Yu