Skip to main content

Research Repository

Advanced Search

Separate encoding of model-based and model-free valuations in the human brain

Beierholm, Ulrik R.; Anen, Cedric; Quartz, Steven; Bossaerts, Peter

Separate encoding of model-based and model-free valuations in the human brain Thumbnail


Authors

Cedric Anen

Steven Quartz

Peter Bossaerts



Abstract

Behavioral studies have long shown that humans solve problems in two ways, one intuitive and fast (System 1, model-free), and the other reflective and slow (System 2, model-based). The neurobiological basis of dual process problem solving remains unknown due to challenges of separating activation in concurrent systems. We present a novel neuroeconomic task that predicts distinct subjective valuation and updating signals corresponding to these two systems. We found two concurrent value signals in human prefrontal cortex: a System 1 model-free reinforcement signal and a System 2 model-based Bayesian signal. We also found a System 1 updating signal in striatal areas and a System 2 updating signal in lateral prefrontal cortex. Further, signals in prefrontal cortex preceded choices that are optimal according to either updating principle, while signals in anterior cingulate cortex and globus pallidus preceded deviations from optimal choice for reinforcement learning. These deviations tended to occur when uncertainty regarding optimal values was highest, suggesting that disagreement between dual systems is mediated by uncertainty rather than conflict, confirming recent theoretical proposals.

Citation

Beierholm, U. R., Anen, C., Quartz, S., & Bossaerts, P. (2011). Separate encoding of model-based and model-free valuations in the human brain. NeuroImage, 58(3), 955-962. https://doi.org/10.1016/j.neuroimage.2011.06.071

Journal Article Type Article
Acceptance Date Jun 24, 2011
Online Publication Date Jul 2, 2011
Publication Date Oct 1, 2011
Deposit Date Oct 30, 2019
Publicly Available Date Mar 28, 2024
Journal NeuroImage
Print ISSN 1053-8119
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 58
Issue 3
Pages 955-962
DOI https://doi.org/10.1016/j.neuroimage.2011.06.071

Files





You might also like



Downloadable Citations