Note to users. If you're seeing this message, it means that your browser cannot find this page's style/presentation instructions -- or possibly that you are using a browser that does not support current Web standards. Find out more about why this message is appearing, and what you can do to make your experience of our site the best it can be.

Site Tools

  • AAAS
  • Subscribe
  • Feedback

Site Search

Search Advanced

Science 25 November 2005:
Vol. 310. no. 5752, pp. 1337 - 1340
DOI: 10.1126/science.1115270
Prev | Table of Contents | Next

Reports

Representation of Action-Specific Reward Values in the Striatum

Kazuyuki Samejima,1*{dagger} Yasumasa Ueda,2 Kenji Doya,1,3 Minoru Kimura2*

The estimation of the reward an action will yield is critical in decision-making. To elucidate the role of the basal ganglia in this process, we recorded striatal neurons of monkeys who chose between left and right handle turns, based on the estimated reward probabilities of the actions. During a delay period before the choices, the activity of more than one-third of striatal projection neurons was selective to the values of one of the two actions. Fewer neurons were tuned to relative values or action choice. These results suggest representation of action values in the striatum, which can guide action selection in the basal ganglia circuit.

1 Department of Computational Neurobiology, ATR Computational Neuroscience Laboratories, 619-0288 Kyoto, Japan.
2 Department of Physiology, Kyoto Prefectural University of Medicine, 602-8566 Kyoto, Japan.
3 Initial Research Project, Okinawa Institute of Science and Technology, 904-2234 Okinawa, Japan.

{dagger} Present address: Brain Science Research Center, Tamagawa University Research Institute, 194-8610 Tokyo, Japan.

* To whom correspondence should be addressed. E-mail: samejima{at}lab.tamagawa.ac.jp (K.S.); mkimura{at}koto.kpu-m.ac.jp (M.K.)

Read the Full Text


THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES:
Evidence for Segregated and Integrative Connectivity Patterns in the Human Basal Ganglia.
B. Draganski, F. Kherif, S. Kloppel, P. A. Cook, D. C. Alexander, G. J. M. Parker, R. Deichmann, J. Ashburner, and R. S. J. Frackowiak (2008)
J. Neurosci. 28, 7143-7152
   Abstract »    Full Text »    PDF »
Understanding the Neural Computations of Arbitrary Visuomotor Learning through fMRI and Associative Learning Theory.
A. Brovelli, N. Laksiri, B. Nazarian, M. Meunier, and D. Boussaoud (2008)
Cereb Cortex 18, 1485-1495
   Abstract »    Full Text »    PDF »
Attaching Values to Actions: Action and Outcome Encoding in the Primate Caudate Nucleus.
C. H. Donahue and H. Seo (2008)
J. Neurosci. 28, 4579-4580
   Full Text »    PDF »
Intention, Choice, and the Medial Frontal Cortex.
M. F.S. RUSHWORTH (2008)
Ann. N.Y. Acad. Sci. 1124, 181-207
   Abstract »    Full Text »    PDF »
Action and Outcome Encoding in the Primate Caudate Nucleus.
B. Lau and P. W. Glimcher (2007)
J. Neurosci. 27, 14502-14514
   Abstract »    Full Text »    PDF »
Inactivation of the Lateral But Not Medial Dorsal Striatum Eliminates the Excitatory Impact of Pavlovian Stimuli on Instrumental Responding.
L. H. Corbit and P. H. Janak (2007)
J. Neurosci. 27, 13977-13981
   Abstract »    Full Text »    PDF »
Order-Dependent Modulation of Directional Signals in the Supplementary and Presupplementary Motor Areas.
J.-W. Sohn and D. Lee (2007)
J. Neurosci. 27, 13655-13666
   Abstract »    Full Text »    PDF »
History- and Current Instruction-Based Coding of Forthcoming Behavioral Outcomes in the Striatum.
H. Yamada, N. Matsumoto, and M. Kimura (2007)
J Neurophysiol 98, 3557-3567
   Abstract »    Full Text »    PDF »
Encoding of Action History in the Rat Ventral Striatum.
Y. B. Kim, N. Huh, H. Lee, E. H. Baeg, D. Lee, and M. W. Jung (2007)
J Neurophysiol 98, 3548-3556
   Abstract »    Full Text »    PDF »
Orbitofrontal Cortex and the Computation of Economic Value.
C. PADOA-SCHIOPPA (2007)
Ann. N.Y. Acad. Sci. 1121, 232-253
   Abstract »    Full Text »    PDF »
Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning.
M. J. Frank, A. A. Moustafa, H. M. Haughey, T. Curran, and K. E. Hutchison (2007)
PNAS 104, 16311-16316
   Abstract »    Full Text »    PDF »
Dynamic Signals Related to Choices and Outcomes in the Dorsolateral Prefrontal Cortex.
H. Seo, D. J. Barraclough, and D. Lee (2007)
Cereb Cortex 17, i110-i117
   Abstract »    Full Text »    PDF »
Understanding Neural Coding through the Model-Based Analysis of Decision Making.
G. Corrado and K. Doya (2007)
J. Neurosci. 27, 8178-8180
   Abstract »    Full Text »    PDF »
Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game.
H. Seo and D. Lee (2007)
J. Neurosci. 27, 8366-8377
   Abstract »    Full Text »    PDF »
Direct Instrumental Conditioning of Neural Activity Using Functional Magnetic Resonance Imaging-Derived Reward Feedback.
S. Bray, S. Shimojo, and J. P. O'Doherty (2007)
J. Neurosci. 27, 7498-7507
   Abstract »    Full Text »    PDF »
Reward-Related Responses in the Human Striatum.
M. R. DELGADO (2007)
Ann. N.Y. Acad. Sci. 1104, 70-88
   Abstract »    Full Text »    PDF »
Model-Based fMRI and Its Application to Reward Learning and Decision Making.
J. P. O'DOHERTY, A. HAMPTON, and H. KIM (2007)
Ann. N.Y. Acad. Sci. 1104, 35-53
   Abstract »    Full Text »    PDF »
Mechanisms of Reinforcement Learning and Decision Making in the Primate Dorsolateral Prefrontal Cortex.
D. LEE and H. SEO (2007)
Ann. N.Y. Acad. Sci. 1104, 108-122
   Abstract »    Full Text »    PDF »
Serotonin and the Evaluation of Future Rewards: Theory, Experiments, and Possible Neural Mechanisms.
N. SCHWEIGHOFER, S. C. TANAKA, and K. DOYA (2007)
Ann. N.Y. Acad. Sci. 1104, 289-300
   Abstract »    Full Text »    PDF »
Calculating the Cost of Acting in Frontal Cortex.
M. E. WALTON, P. H. RUDEBECK, D. M. BANNERMAN, and M. F. S. RUSHWORTH (2007)
Ann. N.Y. Acad. Sci. 1104, 340-356
   Abstract »    Full Text »    PDF »
Striatal Contributions to Reward and Decision Making: Making Sense of Regional Variations in a Reiterated Processing Matrix.
J. R. WICKENS, C. S. BUDD, B. I. HYLAND, and G. W. ARBUTHNOTT (2007)
Ann. N.Y. Acad. Sci. 1104, 192-212
   Abstract »    Full Text »    PDF »
Multiple Representations of Belief States and Action Values in Corticobasal Ganglia Loops.
K. SAMEJIMA and K. DOYA (2007)
Ann. N.Y. Acad. Sci. 1104, 213-228
   Abstract »    Full Text »    PDF »
Adaptation of Prefrontal Cortical Firing Patterns and Their Fidelity to Changes in Action-Reward Contingencies.
W. J. Kargo, B. Szatmary, and D. A. Nitz (2007)
J. Neurosci. 27, 3548-3559
   Abstract »    Full Text »    PDF »
Individual differences and the neural representations of reward expectation and reward prediction error.
M. X Cohen (2007)
Soc Cogn Affect Neurosci 2, 20-30
   Abstract »    Full Text »    PDF »
The Basal Ganglia and cortex implement optimal decision making between alternative actions..
R. Bogacz and K. Gurney (2007)
Neural Comput. 19, 442-477
   Abstract »    Full Text »    PDF »
Shaping of Motor Responses by Incentive Values through the Basal Ganglia.
B. Pasquereau, A. Nadjar, D. Arkadir, E. Bezard, M. Goillandeau, B. Bioulac, C. E. Gross, and T. Boraud (2007)
J. Neurosci. 27, 1176-1183
   Abstract »    Full Text »    PDF »
Reinforcement Learning Signals Predict Future Decisions.
M. X Cohen and C. Ranganath (2007)
J. Neurosci. 27, 371-378
   Abstract »    Full Text »    PDF »
The Actor-Critic Learning Is Behind the Matching Law: Matching Versus Optimal Behaviors.
Y. Sakai and T. Fukai (2007)
Neural Comput. 20, 227-251
   Abstract »    Full Text »    PDF »
A biophysically based neural model of matching law behavior: melioration by stochastic synapses..
A. Soltani and X.-J. Wang (2006)
J. Neurosci. 26, 3731-3744
   Abstract »    Full Text »    PDF »


ADVERTISEMENT
Click Me!

ADVERTISEMENT
Click Me!

To Advertise     Find Products

Science. ISSN 0036-8075 (print), 1095-9203 (online)