Note to users. If you're seeing this message, it means that your browser cannot find this page's style/presentation instructions -- or possibly that you are using a browser that does not support current Web standards. Find out more about why this message is appearing, and what you can do to make your experience of our site the best it can be.

Science 11 March 2005:
Vol. 307. no. 5715, pp. 1642 - 1645
DOI: 10.1126/science.1105370
Prev | Table of Contents | Next

Reports

Adaptive Coding of Reward Value by Dopamine Neurons

Philippe N. Tobler, Christopher D. Fiorillo,* Wolfram Schultz{ddagger}

It is important for animals to estimate the value of rewards as accurately as possible. Because the number of potential reward values is very large, it is necessary that the brain's limited resources be allocated so as to discriminate better among more likely reward outcomes at the expense of less likely outcomes. We found that midbrain dopamine neurons rapidly adapted to the information provided by reward-predicting stimuli. Responses shifted relative to the expected reward value, and the gain adjusted to the variance of reward value. In this way, dopamine neurons maintained their reward sensitivity over a large range of reward values.

Department of Anatomy, University of Cambridge, Downing Street, Cambridge CB2 3DY, UK, and Institute of Physiology, University of Fribourg, CH-1700 Fribourg, Switzerland.

* Present address: Department of Biology, Stanford University, Stanford, CA 94305–5125, USA.

{ddagger} To whom correspondence should be addressed. E-mail: ws234{at}cam.ac.uk

Read the Full Text


THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES:
Reinforcement learning, conditioning, and the brain: Successes and challenges.
T. V. Maia (2009)
Cogn Affect Behav Neurosci 9, 343-364
   Abstract »    PDF »
Aging and the neuroeconomics of decision making: A review.
S. B. R. E. Brown and K. R. Ridderinkhof (2009)
Cogn Affect Behav Neurosci 9, 365-379
   Abstract »    PDF »
Range-Adapting Representation of Economic Value in the Orbitofrontal Cortex.
C. Padoa-Schioppa (2009)
J. Neurosci. 29, 14004-14014
   Abstract »    Full Text »    PDF »
Available alternative incentives modulate anticipatory nucleus accumbens activation.
J. C. Cooper, N. G. Hollon, G. E. Wimmer, and B. Knutson (2009)
Soc Cogn Affect Neurosci
   Abstract »    Full Text »    PDF »
The Role of Dopamine in the Prelimbic Cortex and the Dorsomedial Striatum in Instrumental Conditioning.
B. Lex and W. Hauber (2009)
Cereb Cortex
   Abstract »    Full Text »    PDF »
Which Way Do I Go? Neural Activation in Response to Feedback and Spatial Processing in a Virtual T-Maze.
T. E. Baker and C. B. Holroyd (2009)
Cereb Cortex 19, 1708-1722
   Abstract »    Full Text »    PDF »
Risk-dependent reward value signal in human prefrontal cortex.
P. N. Tobler, G. I. Christopoulos, J. P. O'Doherty, R. J. Dolan, and W. Schultz (2009)
PNAS 106, 7185-7190
   Abstract »    Full Text »    PDF »
The Neurobiology of Reference-Dependent Value Computation.
B. De Martino, D. Kumaran, B. Holt, and R. J. Dolan (2009)
J. Neurosci. 29, 3833-3842
   Abstract »    Full Text »    PDF »
Short-Term Temporal Discounting of Reward Value in Human Ventral Striatum.
L. Gregorios-Pippas, P. N. Tobler, and W. Schultz (2009)
J Neurophysiol 101, 1507-1523
   Abstract »    Full Text »    PDF »
The Neural Basis of Human Social Values: Evidence from Functional MRI.
R. Zahn, J. Moll, M. Paiva, G. Garrido, F. Krueger, E. D. Huey, and J. Grafman (2009)
Cereb Cortex 19, 276-283
   Abstract »    Full Text »    PDF »
The Rebirth of Neuroscience in Psychosomatic Medicine, Part I: Historical Context, Methods, and Relevant Basic Science.
R. D. Lane, S. R. Waldstein, M. A. Chesney, J. R. Jennings, W. R. Lovallo, P. J. Kozel, R. M. Rose, D. A. Drossman, N. Schneiderman, J. F. Thayer, et al. (2009)
Psychosom Med 71, 117-134
   Abstract »    Full Text »    PDF »
The role of the striatum in aversive learning and aversive prediction errors.
M. R Delgado, J. Li, D. Schiller, and E. A Phelps (2008)
Phil Trans R Soc B 363, 3787-3800
   Abstract »    Full Text »    PDF »
Explicit neural signals reflecting reward uncertainty.
W. Schultz, K. Preuschoff, C. Camerer, M. Hsu, C. D Fiorillo, P. N Tobler, and P. Bossaerts (2008)
Phil Trans R Soc B 363, 3801-3811
   Abstract »    Full Text »    PDF »
Neuroethology of reward and decision making.
K. K Watson and M. L Platt (2008)
Phil Trans R Soc B 363, 3825-3835
   Abstract »    Full Text »    PDF »
Reward prediction error signals by reticular formation neurons.
C. B. Puryear and S. J.Y. Mizumori (2008)
Learn. Mem. 15, 895-898
   Abstract »    Full Text »    PDF »
Neurobiological studies of risk assessment: A comparison of expected utility and mean-variance approaches.
M. d'Acremont and P. Bossaerts (2008)
Cogn Affect Behav Neurosci 8, 363-374
   Abstract »    PDF »
The role of moral utility in decision making: An interdisciplinary framework.
P. N. Tobler, A. Kalis, and T. Kalenscher (2008)
Cogn Affect Behav Neurosci 8, 390-401
   Abstract »    PDF »
A Role for Dopamine in Temporal Decision Making and Reward Maximization in Parkinsonism.
A. A. Moustafa, M. X. Cohen, S. J. Sherman, and M. J. Frank (2008)
J. Neurosci. 28, 12294-12304
   Abstract »    Full Text »    PDF »
A Dopamine-Acetylcholine Cascade: Simulating Learned and Lesion-Induced Behavior of Striatal Cholinergic Interneurons.
C. O. Tan and D. Bullock (2008)
J Neurophysiol 100, 2409-2421
   Abstract »    Full Text »    PDF »
Moment-to-Moment Tracking of State Value in the Amygdala.
M. A. Belova, J. J. Paton, and C. D. Salzman (2008)
J. Neurosci. 28, 10023-10030
   Abstract »    Full Text »    PDF »
A Local Circuit Model of Learned Striatal and Dopamine Cell Responses under Probabilistic Schedules of Reward.
C. O. Tan and D. Bullock (2008)
J. Neurosci. 28, 10062-10074
   Abstract »    Full Text »    PDF »
Reward-Predictive Cues Enhance Excitatory Synaptic Strength onto Midbrain Dopamine Neurons.
G. D. Stuber, M. Klanker, B. de Ridder, M. S. Bowers, R. N. Joosten, M. G. Feenstra, and A. Bonci (2008)
Science 321, 1690-1692
   Abstract »    Full Text »    PDF »
Dynamic changes in accumbens dopamine correlate with learning during intracranial self-stimulation.
C. A. Owesson-White, J. F. Cheer, M. Beyene, R. M. Carelli, and R. M. Wightman (2008)
PNAS 105, 11957-11962
   Abstract »    Full Text »    PDF »
Influence of Reward Delays on Responses of Dopamine Neurons.
S. Kobayashi and W. Schultz (2008)
J. Neurosci. 28, 7837-7846
   Abstract »    Full Text »    PDF »
Calpain in the CNS: From Synaptic Function to Neurotoxicity.
J. Liu, M. C. Liu, and K. K. W. Wang (2008)
Science Signaling 1, re1
   Abstract »    Full Text »    PDF »
Placebo and Nocebo Effects Are Defined by Opposite Opioid and Dopaminergic Responses.
D. J. Scott, C. S. Stohler, C. M. Egnatuk, H. Wang, R. A. Koeppe, and J.-K. Zubieta (2008)
Arch Gen Psychiatry 65, 220-231
   Abstract »    Full Text »    PDF »
Behavioral Reactivity and Addiction: The Adaptation of Behavioral Response to Reward Opportunities.
J. A. Trafton and E. V. Gifford (2008)
J Neuropsychiatry Clin Neurosci 20, 23-35
   Abstract »    Full Text »    PDF »
Order-Dependent Modulation of Directional Signals in the Supplementary and Presupplementary Motor Areas.
J.-W. Sohn and D. Lee (2007)
J. Neurosci. 27, 13655-13666
   Abstract »    Full Text »    PDF »
Extending a biologically inspired model of choice: multi-alternatives, nonlinearity and value-based multidimensional choice.
R. Bogacz, M. Usher, J. Zhang, and J. L McClelland (2007)
Phil Trans R Soc B 362, 1655-1670
   Abstract »    Full Text »    PDF »
Gene gene interaction associated with neural reward sensitivity.
J. Yacubian, T. Sommer, K. Schroeder, J. Glascher, R. Kalisch, B. Leuenberger, D. F. Braus, and C. Buchel (2007)
PNAS 104, 8125-8130
   Abstract »    Full Text »    PDF »
The Nucleus Accumbens and Pavlovian Reward Learning.
J. J. Day and R. M. Carelli (2007)
Neuroscientist 13, 148-159
   Abstract »    PDF »
Calcium Influx through L-type Channels Generates Protein Kinase M to Induce Burst Firing of Dopamine Cells in the Rat Ventral Tegmental Area.
Y. Liu, J. Dore, and X. Chen (2007)
J. Biol. Chem. 282, 8594-8603
   Abstract »    Full Text »    PDF »
Dopamine Gates Action Potential Backpropagation in Midbrain Dopaminergic Neurons.
L. J. Gentet and S. R. Williams (2007)
J. Neurosci. 27, 1892-1901
   Abstract »    Full Text »    PDF »
Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems.
P. N. Tobler, J. P. O'Doherty, R. J. Dolan, and W. Schultz (2007)
J Neurophysiol 97, 1621-1632
   Abstract »    Full Text »    PDF »
Shaping of Motor Responses by Incentive Values through the Basal Ganglia.
B. Pasquereau, A. Nadjar, D. Arkadir, E. Bezard, M. Goillandeau, B. Bioulac, C. E. Gross, and T. Boraud (2007)
J. Neurosci. 27, 1176-1183
   Abstract »    Full Text »    PDF »
Is Decreased Prefrontal Cortical Sensitivity to Monetary Reward Associated With Impaired Motivation and Self-Control in Cocaine Addiction?.
R. Z. Goldstein, N. Alia-Klein, D. Tomasi, L. Zhang, L. A. Cottone, T. Maloney, F. Telang, E. C. Caparelli, L. Chang, T. Ernst, et al. (2007)
Am J Psychiatry 164, 43-51
   Abstract »    Full Text »    PDF »
Feeding behavior of Aplysia: A model system for comparing cellular mechanisms of classical and operant conditioning.
D. A. Baxter and J. H. Byrne (2006)
Learn. Mem. 13, 669-680
   Abstract »    Full Text »    PDF »
Variations in the human pain stress experience mediated by ventral and dorsal Basal Ganglia dopamine activity..
D. J. Scott, M. M. Heitzeg, R. A. Koeppe, C. S. Stohler, and J.-K. Zubieta (2006)
J. Neurosci. 26, 10789-10795
   Abstract »    Full Text »    PDF »
Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain..
J. Yacubian, J. Glascher, K. Schroeder, T. Sommer, D. F. Braus, and C. Buchel (2006)
J. Neurosci. 26, 9530-9537
   Abstract »    Full Text »    PDF »
Rule learning and reward contingency are associated with dissociable patterns of dopamine activation in the rat prefrontal cortex, nucleus accumbens, and dorsal striatum..
M. R. Stefani and B. Moghaddam (2006)
J. Neurosci. 26, 8810-8818
   Abstract »    Full Text »    PDF »
Reward association affects neuronal responses to visual stimuli in macaque te and perirhinal cortices..
T. Mogami and K. Tanaka (2006)
J. Neurosci. 26, 6761-6770
   Abstract »    Full Text »    PDF »
Mistaking a House for a Face: Neural Correlates of Misperception in Healthy Humans.
C. Summerfield, T. Egner, J. Mangels, and J. Hirsch (2006)
Cereb Cortex 16, 500-508
   Abstract »    Full Text »    PDF »
Basal Ganglia Orient Eyes to Reward.
O. Hikosaka, K. Nakamura, and H. Nakahara (2006)
J Neurophysiol 95, 567-584
   Abstract »    Full Text »    PDF »
Cerebral Changes during Performance of Overlearned Arbitrary Visuomotor Associations.
M. J. Grol, F. P. de Lange, F. A. J. Verstraten, R. E. Passingham, and I. Toni (2006)
J. Neurosci. 26, 117-125
   Abstract »    Full Text »    PDF »


To Advertise     Find Products

Science. ISSN 0036-8075 (print), 1095-9203 (online)