Dr Ulrik Beierholm ulrik.beierholm@durham.ac.uk
Associate Professor
Separate encoding of model-based and model-free valuations in the human brain
Beierholm, Ulrik R.; Anen, Cedric; Quartz, Steven; Bossaerts, Peter
Authors
Cedric Anen
Steven Quartz
Peter Bossaerts
Abstract
Behavioral studies have long shown that humans solve problems in two ways, one intuitive and fast (System 1, model-free), and the other reflective and slow (System 2, model-based). The neurobiological basis of dual process problem solving remains unknown due to challenges of separating activation in concurrent systems. We present a novel neuroeconomic task that predicts distinct subjective valuation and updating signals corresponding to these two systems. We found two concurrent value signals in human prefrontal cortex: a System 1 model-free reinforcement signal and a System 2 model-based Bayesian signal. We also found a System 1 updating signal in striatal areas and a System 2 updating signal in lateral prefrontal cortex. Further, signals in prefrontal cortex preceded choices that are optimal according to either updating principle, while signals in anterior cingulate cortex and globus pallidus preceded deviations from optimal choice for reinforcement learning. These deviations tended to occur when uncertainty regarding optimal values was highest, suggesting that disagreement between dual systems is mediated by uncertainty rather than conflict, confirming recent theoretical proposals.
Citation
Beierholm, U. R., Anen, C., Quartz, S., & Bossaerts, P. (2011). Separate encoding of model-based and model-free valuations in the human brain. NeuroImage, 58(3), 955-962. https://doi.org/10.1016/j.neuroimage.2011.06.071
Journal Article Type | Article |
---|---|
Acceptance Date | Jun 24, 2011 |
Online Publication Date | Jul 2, 2011 |
Publication Date | Oct 1, 2011 |
Deposit Date | Oct 30, 2019 |
Publicly Available Date | Oct 31, 2019 |
Journal | NeuroImage |
Print ISSN | 1053-8119 |
Publisher | Elsevier |
Peer Reviewed | Peer Reviewed |
Volume | 58 |
Issue | 3 |
Pages | 955-962 |
DOI | https://doi.org/10.1016/j.neuroimage.2011.06.071 |
Files
Accepted Journal Article
(962 Kb)
PDF
Publisher Licence URL
http://creativecommons.org/licenses/by-nc-nd/4.0/
Copyright Statement
© 2011 This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/
You might also like
Developmental changes in colour constancy in a naturalistic object selection task
(2022)
Journal Article
Evaluating Gaussian Grasp Maps for Generative Grasping Models
(2022)
Conference Proceeding
Dopamine and reward-related vigor in younger and older adults
(2022)
Journal Article
Bayesian Causal Inference: A Unifying Neuroscience Theory
(2022)
Journal Article