Note to users. If you're seeing this message, it means that your browser cannot find this page's style/presentation instructions -- or possibly that you are using a browser that does not support current Web standards. Find out more about why this message is appearing, and what you can do to make your experience of our site the best it can be.

Science 9 April 2004:
Vol. 304. no. 5668, pp. 307 - 310
DOI: 10.1126/science.1093223
Prev | Table of Contents | Next

Reports

Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex

Matthew R. Roesch* and Carl R. Olson

In several areas of the macaque brain, neurons fire during delayed-response tasks at a rate determined by the value of the reward expected at the end of the trial. The activity of these neurons might be related to the value of the expected reward or to the degree of motivation induced by expectation of the reward. We describe results indicating that the nature of reward-dependent activity varies across areas. Neuronal activity in orbitofrontal cortex represents the value of the expected reward, whereas neuronal activity in premotor cortex reflects the degree of motivation.

Center for the Neural Basis of Cognition, Mellon Institute, Room 115, 4400 Fifth Avenue, Pittsburgh, PA 15213, USA, and Department of Neuroscience, University of Pittsburgh, Pittsburgh, PA 15260, USA.

* To whom correspondence should be addressed. E-mail: roesch{at}cnbc.cmu.edu

Read the Full Text


THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES:
Dynamic Encoding of Movement Direction in Motor Cortical Neurons.
J. Rickert, A. Riehle, A. Aertsen, S. Rotter, and M. P. Nawrot (2009)
J. Neurosci. 29, 13870-13882
   Abstract »    Full Text »    PDF »
A role for the ventral premotor cortex beyond performance monitoring.
J. L. Pardo-Vazquez, V. Leboran, and C. Acuna (2009)
PNAS 106, 18815-18819
   Abstract »    Full Text »    PDF »
Immaturities in Reward Processing and Its Influence on Inhibitory Control in Adolescence.
C.F. Geier, R. Terwilliger, T. Teslovich, K. Velanova, and B. Luna (2009)
Cereb Cortex
   Abstract »    Full Text »    PDF »
Beyond the Reward Pathway: Coding Reward Magnitude and Error in the Rat Subthalamic Nucleus.
S. Lardeux, R. Pernaud, D. Paleressompoulle, and C. Baunez (2009)
J Neurophysiol 102, 2526-2537
   Abstract »    Full Text »    PDF »
The Convergence of Information about Rewarding and Aversive Stimuli in Single Neurons.
S. E. Morrison and C. D. Salzman (2009)
J. Neurosci. 29, 11471-11483
   Abstract »    Full Text »    PDF »
Orbitofrontal and Anterior Cingulate Cortex Neurons Selectively Process Cocaine-Associated Environmental Cues in the Rhesus Monkey.
E. H. Baeg, M. E. Jackson, H. P. Jedema, and C. W. Bradberry (2009)
J. Neurosci. 29, 11619-11627
   Abstract »    Full Text »    PDF »
Reward Modulates Attention Independently of Action Value in Posterior Parietal Cortex.
C. J. Peck, D. C. Jangraw, M. Suzuki, R. Efem, and J. Gottlieb (2009)
J. Neurosci. 29, 11182-11191
   Abstract »    Full Text »    PDF »
Single-Cell and Population Coding of Expected Reward Probability in the Orbitofrontal Cortex of the Rat.
E. van Duuren, G. van der Plasse, J. Lankelma, R. N. J. M. A. Joosten, M. G. P. Feenstra, and C. M. A. Pennartz (2009)
J. Neurosci. 29, 8965-8976
   Abstract »    Full Text »    PDF »
Dissociable Components of Rule-Guided Behavior Depend on Distinct Medial and Prefrontal Regions.
M. J. Buckley, F. A. Mansouri, H. Hoda, M. Mahboubi, P. G. F. Browning, S. C. Kwok, A. Phillips, and K. Tanaka (2009)
Science 325, 52-58
   Abstract »    Full Text »    PDF »
Evidence of Action Sequence Chunking in Goal-Directed Instrumental Conditioning and Its Dependence on the Dorsomedial Prefrontal Cortex.
S. B. Ostlund, N. E. Winterbauer, and B. W. Balleine (2009)
J. Neurosci. 29, 8280-8287
   Abstract »    Full Text »    PDF »
Dynamic Encoding of Responses and Outcomes by Neurons in Medial Prefrontal Cortex.
C.-H. Luk and J. D. Wallis (2009)
J. Neurosci. 29, 7526-7539
   Abstract »    Full Text »    PDF »
Fictive Reward Signals in the Anterior Cingulate Cortex.
B. Y. Hayden, J. M. Pearson, and M. L. Platt (2009)
Science 324, 948-950
   Abstract »    Full Text »    PDF »
Different Pedunculopontine Tegmental Neurons Signal Predicted and Actual Task Rewards.
K.-i. Okada, K. Toyama, Y. Inoue, T. Isa, and Y. Kobayashi (2009)
J. Neurosci. 29, 4858-4870
   Abstract »    Full Text »    PDF »
The Neurobiology of Reference-Dependent Value Computation.
B. De Martino, D. Kumaran, B. Holt, and R. J. Dolan (2009)
J. Neurosci. 29, 3833-3842
   Abstract »    Full Text »    PDF »
Behavioral and Neural Changes after Gains and Losses of Conditioned Reinforcers.
H. Seo and D. Lee (2009)
J. Neurosci. 29, 3627-3641
   Abstract »    Full Text »    PDF »
Monkey Supplementary Eye Field Neurons Signal the Ordinal Position of Both Actions and Objects.
T. K. Berdyyeva and C. R. Olson (2009)
J. Neurosci. 29, 591-599
   Abstract »    Full Text »    PDF »
Measuring and Modeling the Interaction Among Reward Size, Delay to Reward, and Satiation Level on Motivation in Monkeys.
T. Minamimoto, G. La Camera, and B. J. Richmond (2009)
J Neurophysiol 101, 437-447
   Abstract »    Full Text »    PDF »
The contribution of distinct subregions of the ventromedial frontal cortex to emotion, social behavior, and decision making.
P. H. Rudebeck, D. M. Bannerman, and M. F. S. Rushworth (2008)
Cogn Affect Behav Neurosci 8, 485-497
   Abstract »    PDF »
Moment-to-Moment Tracking of State Value in the Amygdala.
M. A. Belova, J. J. Paton, and C. D. Salzman (2008)
J. Neurosci. 28, 10023-10030
   Abstract »    Full Text »    PDF »
Population Coding of Reward Magnitude in the Orbitofrontal Cortex of the Rat.
E. van Duuren, J. Lankelma, and C. M. A. Pennartz (2008)
J. Neurosci. 28, 8590-8603
   Abstract »    Full Text »    PDF »
Olfactory Learning-Induced Long-Lasting Enhancement of Descending and Ascending Synaptic Transmission to the Piriform Cortex.
Y. Cohen, I. Reuveni, E. Barkai, and M. Maroun (2008)
J. Neurosci. 28, 6664-6669
   Abstract »    Full Text »    PDF »
The human ventromedial frontal lobe is critical for learning from negative feedback.
E. Z. Wheeler and L. K. Fellows (2008)
Brain 131, 1323-1331
   Abstract »    Full Text »    PDF »
Aging affects acquisition and reversal of reward-based associative learning.
J. A. Weiler, C. Bellebaum, and I. Daum (2008)
Learn. Mem. 15, 190-197
   Abstract »    Full Text »    PDF »
Focal basal ganglia lesions are associated with impairments in reward-based reversal learning.
C. Bellebaum, B. Koch, M. Schwarz, and I. Daum (2008)
Brain 131, 829-841
   Abstract »    Full Text »    PDF »
Dynamic Changes in Representations of Preceding and Upcoming Reward in Monkey Orbitofrontal Cortex.
J. M. Simmons and B. J. Richmond (2008)
Cereb Cortex 18, 93-103
   Abstract »    Full Text »    PDF »
Immediate Reward Bias in Humans: Fronto-Parietal Networks and a Role for the Catechol-O-Methyltransferase 158Val/Val Genotype.
C. A. Boettiger, J. M. Mitchell, V. C. Tavares, M. Robertson, G. Joslyn, M. D'Esposito, and H. L. Fields (2007)
J. Neurosci. 27, 14383-14391
   Abstract »    Full Text »    PDF »
Order-Dependent Modulation of Directional Signals in the Supplementary and Presupplementary Motor Areas.
J.-W. Sohn and D. Lee (2007)
J. Neurosci. 27, 13655-13666
   Abstract »    Full Text »    PDF »
The Role of Ventromedial Prefrontal Cortex in Decision Making: Judgment under Uncertainty or Judgment Per Se?.
L. K. Fellows and M. J. Farah (2007)
Cereb Cortex 17, 2669-2674
   Abstract »    Full Text »    PDF »
Orbital Prefrontal Cortex Is Required for Object-in-Place Scene Memory But Not Performance of a Strategy Implementation Task.
M. G. Baxter, D. Gaffan, D. A. Kyriazis, and A. S. Mitchell (2007)
J. Neurosci. 27, 11327-11333
   Abstract »    Full Text »    PDF »
Cortical mechanisms of action selection: the affordance competition hypothesis.
P. Cisek (2007)
Phil Trans R Soc B 362, 1585-1599
   Abstract »    Full Text »    PDF »
Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions.
H. Plassmann, J. O'Doherty, and A. Rangel (2007)
J. Neurosci. 27, 9984-9988
   Abstract »    Full Text »    PDF »
Functional Specialization of the Primate Frontal Cortex during Decision Making.
D. Lee, M. F. S. Rushworth, M. E. Walton, M. Watanabe, and M. Sakagami (2007)
J. Neurosci. 27, 8170-8173
   Abstract »    Full Text »    PDF »
Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task.
E. van Duuren, F. A. N. Escamez, R. N.J.M.A. Joosten, R. Visser, A. B. Mulder, and C. M.A. Pennartz (2007)
Learn. Mem. 14, 446-456
   Abstract »    Full Text »    PDF »
The Influence of Expected Value on Saccadic Preparation.
D. M. Milstein and M. C. Dorris (2007)
J. Neurosci. 27, 4810-4818
   Abstract »    Full Text »    PDF »
Associative Encoding in Anterior Piriform Cortex versus Orbitofrontal Cortex during Odor Discrimination and Reversal Learning.
M. R. Roesch, T. A. Stalnaker, and G. Schoenbaum (2007)
Cereb Cortex 17, 643-652
   Abstract »    Full Text »    PDF »
Addiction: A Disease of Learning and Memory.
S. E. Hyman (2007)
Focus 5, 220-228
   Abstract »    Full Text »    PDF »
Integrated neural processes for defining potential actions and deciding between them: a computational model..
P. Cisek (2006)
J. Neurosci. 26, 9761-9770
   Abstract »    Full Text »    PDF »
Contrasting Effects of Reward Expectation on Sensory and Motor Memories in Primate Prefrontal Neurons.
K.-i. Amemori and T. Sawaguchi (2006)
Cereb Cortex 16, 1002-1015
   Abstract »    Full Text »    PDF »
Comparison of reward modulation in the frontal eye field and caudate of the macaque..
L. Ding and O. Hikosaka (2006)
J. Neurosci. 26, 6695-6703
   Abstract »    Full Text »    PDF »
Role of dopamine in the primate caudate nucleus in reward modulation of saccades..
K. Nakamura and O. Hikosaka (2006)
J. Neurosci. 26, 5360-5369
   Abstract »    Full Text »    PDF »
Basal Ganglia Orient Eyes to Reward.
O. Hikosaka, K. Nakamura, and H. Nakahara (2006)
J Neurophysiol 95, 567-584
   Abstract »    Full Text »    PDF »
Neural Circuitry Underlying Rule Use in Humans and Nonhuman Primates.
S. A. Bunge, J. D. Wallis, A. Parker, M. Brass, E. A. Crone, E. Hoshi, and K. Sakai (2005)
J. Neurosci. 25, 10347-10350
   Full Text »    PDF »
Neuronal Activity in Primate Orbitofrontal Cortex Reflects the Value of Time.
M. R. Roesch and C. R. Olson (2005)
J Neurophysiol 94, 2457-2471
   Abstract »    Full Text »    PDF »
Comparison of the Effects of Bilateral Orbital Prefrontal Cortex Lesions and Amygdala Lesions on Emotional Responses in Rhesus Monkeys.
A. Izquierdo, R. K. Suda, and E. A. Murray (2005)
J. Neurosci. 25, 8534-8542
   Abstract »    Full Text »    PDF »
Addiction: A Disease of Learning and Memory.
S. E. Hyman (2005)
Am J Psychiatry 162, 1414-1422
   Abstract »    Full Text »    PDF »
Supplementary Motor Area Encodes Reward Expectancy in Eye-Movement Tasks.
M. Campos, B. Breznen, K. Bernheim, and R. A. Andersen (2005)
J Neurophysiol 94, 1325-1335
   Abstract »    Full Text »    PDF »
Neuronal Activity Dependent on Anticipated and Elapsed Delay in Macaque Prefrontal Cortex, Frontal and Supplementary Eye Fields, and Premotor Cortex.
M. R. Roesch and C. R. Olson (2005)
J Neurophysiol 94, 1469-1497
   Abstract »    Full Text »    PDF »
Complementary Process to Response Bias in the Centromedian Nucleus of the Thalamus.
T. Minamimoto, Y. Hori, and M. Kimura (2005)
Science 308, 1798-1801
   Abstract »    Full Text »    PDF »
Electrophysiological correlates of reward prediction error recorded in the human prefrontal cortex.
H. Oya, R. Adolphs, H. Kawasaki, A. Bechara, A. Damasio, and M. A. Howard III (2005)
PNAS 102, 8351-8356
   Abstract »    Full Text »    PDF »
Fos protein expression in olfactory-related brain areas after learning and after reactivation of a slowly acquired olfactory discrimination task in the rat.
F. Roullet, F. Lienard, F. Datiche, and M. Cattarelli (2005)
Learn. Mem. 12, 307-317
   Abstract »    Full Text »    PDF »
Bilateral Orbital Prefrontal Cortex Lesions in Rhesus Monkeys Disrupt Choices Guided by Both Reward Value and Reward Contingency.
A. Izquierdo, R. K. Suda, and E. A. Murray (2004)
J. Neurosci. 24, 7540-7548
   Abstract »    Full Text »    PDF »
Minerva.
(2004)
BMJ 328, 964
   Full Text »    PDF »


To Advertise     Find Products

Science. ISSN 0036-8075 (print), 1095-9203 (online)