Timezone: »
Intelligent agents are often faced with the need to choose actions with uncertain consequences, and to modify those actions according to ongoing sensory processing and changing task demands. The requisite ability to dynamically modify or cancel planned actions is known as inhibitory control in psychology. We formalize inhibitory control as a rational decision-making problem, and apply to it to the classical stop-signal task. Using Bayesian inference and stochastic control tools, we show that the optimal policy systematically depends on various parameters of the problem, such as the relative costs of different action choices, the noise level of sensory inputs, and the dynamics of changing environmental demands. Our normative model accounts for a range of behavioral data in humans and animals in the stop-signal task, suggesting that the brain implements statistically optimal, dynamically adaptive, and reward-sensitive decision-making in the context of inhibitory control problems.
Author Information
Pradeep Shenoy (University of California, San Diego)
Rajesh PN Rao (University of Washington)
Angela Yu (UC San Diego)
Related Events (a corresponding poster, oral, or spotlight)
-
2010 Poster: A rational decision making framework for inhibitory control »
Tue. Dec 7th 08:00 -- 08:00 AM Room
More from the Same Authors
-
2021 : Panel I: Human decisions »
Jennifer Trueblood · Alex Peysakhovich · Angela Yu · Ori Plonsky · Tal Yarkoni · Daniel Bjorkegren -
2019 : Poster Session »
Pravish Sainath · Mohamed Akrout · Charles Delahunt · Nathan Kutz · Guangyu Robert Yang · Joseph Marino · L F Abbott · Nicolas Vecoven · Damien Ernst · andrew warrington · Michael Kagan · Kyunghyun Cho · Kameron Harris · Leopold Grinberg · John J. Hopfield · Dmitry Krotov · Taliah Muhammad · Erick Cobos · Edgar Walker · Jacob Reimer · Andreas Tolias · Alexander Ecker · Janaki Sheth · Yu Zhang · Maciej Wołczyk · Jacek Tabor · Szymon Maszke · Roman Pogodin · Dane Corneil · Wulfram Gerstner · Baihan Lin · Guillermo Cecchi · Jenna M Reinen · Irina Rish · Guillaume Bellec · Darjan Salaj · Anand Subramoney · Wolfgang Maass · Yueqi Wang · Ari Pakman · Jin Hyung Lee · Liam Paninski · Bryan Tripp · Colin Graber · Alex Schwing · Luke Prince · Gabriel Ocker · Michael Buice · Benjamin Lansdell · Konrad Kording · Jack Lindsey · Terrence Sejnowski · Matthew Farrell · Eric Shea-Brown · Nicolas Farrugia · Victor Nepveu · Jiwoong Im · Kristin Branson · Brian Hu · Ramakrishnan Iyer · Stefan Mihalas · Sneha Aenugu · Hananel Hazan · Sihui Dai · Tan Nguyen · Doris Tsao · Richard Baraniuk · Anima Anandkumar · Hidenori Tanaka · Aran Nayebi · Stephen Baccus · Surya Ganguli · Dean Pospisil · Eilif Muller · Jeffrey S Cheng · Gaël Varoquaux · Kamalaker Dadi · Dimitrios C Gklezakos · Rajesh PN Rao · Anand Louis · Christos Papadimitriou · Santosh Vempala · Naganand Yadati · Daniel Zdeblick · Daniela M Witten · Nicholas Roberts · Vinay Prabhu · Pierre Bellec · Poornima Ramesh · Jakob H Macke · Santiago Cadena · Guillaume Bellec · Franz Scherr · Owen Marschall · Robert Kim · Hannes Rapp · Marcio Fonseca · Oliver Armitage · Jiwoong Im · Thomas Hardcastle · Abhishek Sharma · Wyeth Bair · Adrian Valente · Shane Shang · Merav Stern · Rutuja Patil · Peter Wang · Sruthi Gorantla · Peter Stratton · Tristan Edwards · Jialin Lu · Martin Ester · Yurii Vlasov · Siavash Golkar -
2019 : Panel Discussion led by Grace Lindsay »
Grace Lindsay · Blake Richards · Doina Precup · Jacqueline Gottlieb · Jeff Clune · Jane Wang · Richard Sutton · Angela Yu · Ida Momennejad -
2019 : Invited Talk #6: Features or Bugs: Synergistic Idiosyncrasies in Human Learning and Decision-Making »
Angela Yu -
2019 Poster: A Bayesian Theory of Conformity in Collective Decision Making »
Koosha Khalvati · Saghar Mirbagheri · Seongmin A. Park · Jean-Claude Dreher · Rajesh PN Rao -
2018 Poster: Why so gloomy? A Bayesian explanation of human pessimism bias in the multi-armed bandit task »
Dalin Guo · Angela Yu -
2018 Poster: Demystifying excessively volatile human learning: A Bayesian persistent prior and a neural approximation »
Chaitanya Ryali · Gautam Reddy · Angela Yu -
2018 Poster: Beauty-in-averageness and its contextual modulations: A Bayesian statistical account »
Chaitanya Ryali · Angela Yu -
2017 : Computational modeling of human face processing »
Angela Yu -
2017 : Workshop overview »
Michael Mozer · Angela Yu · Brenden Lake -
2017 Workshop: Cognitively Informed Artificial Intelligence: Insights From Natural Intelligence »
Michael Mozer · Brenden Lake · Angela Yu -
2016 : Rajesh Rao - Modeling human decision making using POMDPs »
Rajesh PN Rao -
2016 Poster: A Probabilistic Model of Social Decision Making based on Reward Maximization »
Koosha Khalvati · Seongmin A. Park · Jean-Claude Dreher · Rajesh PN Rao -
2015 Poster: A Bayesian Framework for Modeling Confidence in Perceptual Decision Making »
Koosha Khalvati · Rajesh PN Rao -
2014 Poster: Neurons as Monte Carlo Samplers: Bayesian Inference and Learning in Spiking Networks »
Yanping Huang · Rajesh PN Rao -
2013 Poster: Forgetful Bayes and myopic planning: Human learning and decision-making in a bandit setting »
Shunan Zhang · Angela Yu -
2013 Poster: Context-sensitive active sensing in humans »
Sheeraz Ahmad · He Huang · Angela Yu -
2012 Poster: Strategic Impatience in Go/NoGo versus Forced-Choice Decision-Making »
Pradeep Shenoy · Angela Yu -
2012 Poster: How Prior Probability Influences Decision Making: A Unifying Probabilistic Model »
Yanping Huang · Abram Friesen · Timothy Hanks · Michael N Shadlen · Rajesh PN Rao -
2012 Oral: Strategic Impatience in Go/NoGo versus Forced-Choice Decision-Making »
Pradeep Shenoy · Angela Yu -
2008 Poster: Sequential effects: Superstition or rational behavior? »
Angela Yu · Jonathan D Cohen -
2008 Spotlight: Sequential effects: Superstition or rational behavior? »
Angela Yu · Jonathan D Cohen -
2007 Spotlight: Sequential Hypothesis Testing under Stochastic Deadlines »
Peter Frazier · Angela Yu -
2007 Poster: Sequential Hypothesis Testing under Stochastic Deadlines »
Peter Frazier · Angela Yu -
2006 Poster: Learning Nonparametric Models for Probabilistic Imitation »
David Grimes · Daniel Rashid · Rajesh PN Rao -
2006 Poster: Optimal Change-Detection and Spiking Neurons »
Angela Yu