In order to choose the best action for maximizing fitness, mammals can estimate the reward expectations (value) linked to available actions based on past environmental outcomes. Value updates are performed by comparing the current value with the actual environmental outcomes (prediction error). The anterior cingulate cortex (ACC) has been shown to be critically involved in the computation of value and its variability across time (volatility). Previously, we proposed a new neural model of the ACC based on single-unit ACC neurophysiology, the Reward Value and Prediction Model (RVPM). Here, using the RVPM in computer simulations and in a model-based fMRI study, we found that highly uncertain but non-volatile environments activate ACC more than volatile environments, demonstrating that value estimation by means of prediction error computation can account for the effect of volatility in ACC. These findings suggest that ACC response to volatility can be parsimoniously explained by basic ACC reward processing. (C) 2012 Elsevier Ltd. All rights reserved.

Value and prediction error estimation account for volatility effects in ACC: A model-based fMRI study

Silvetti Massimo;
2013

Abstract

In order to choose the best action for maximizing fitness, mammals can estimate the reward expectations (value) linked to available actions based on past environmental outcomes. Value updates are performed by comparing the current value with the actual environmental outcomes (prediction error). The anterior cingulate cortex (ACC) has been shown to be critically involved in the computation of value and its variability across time (volatility). Previously, we proposed a new neural model of the ACC based on single-unit ACC neurophysiology, the Reward Value and Prediction Model (RVPM). Here, using the RVPM in computer simulations and in a model-based fMRI study, we found that highly uncertain but non-volatile environments activate ACC more than volatile environments, demonstrating that value estimation by means of prediction error computation can account for the effect of volatility in ACC. These findings suggest that ACC response to volatility can be parsimoniously explained by basic ACC reward processing. (C) 2012 Elsevier Ltd. All rights reserved.
2013
Istituto di Scienze e Tecnologie della Cognizione - ISTC
Volatility
ACC
Reinforcement learning
Reward
Prediction error
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/404600
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? 48
social impact