Note to users. If you're seeing this message, it means that your browser cannot find this page's style/presentation instructions -- or possibly that you are using a browser that does not support current Web standards. Find out more about why this message is appearing, and what you can do to make your experience of our site the best it can be.

Science 7 June 2002:
Vol. 296. no. 5574, pp. 1829 - 1832
DOI: 10.1126/science.1070291
Prev | Table of Contents | Next

Research Articles

Direct Cortical Control of 3D Neuroprosthetic Devices

Dawn M. Taylor,1 Stephen I. Helms Tillery,1 Andrew B. Schwartz12*

Three-dimensional (3D) movement of neuroprosthetic devices can be controlled by the activity of cortical neurons when appropriate algorithms are used to decode intended movement in real time. Previous studies assumed that neurons maintain fixed tuning properties, and the studies used subjects who were unaware of the movements predicted by their recorded units. In this study, subjects had real-time visual feedback of their brain-controlled trajectories. Cell tuning properties changed when used for brain-controlled movements. By using control algorithms that track these changes, subjects made long sequences of 3D movements using far fewer cortical units than expected. Daily practice improved movement accuracy and the directional tuning of these units.

1 Department of Bioengineering, Arizona State University, Tempe, AZ 85287-6006, USA.
2 The Neurosciences Institute, San Diego, CA 92121, USA.
*   To whom correspondence should be addressed. E-mail: aschwartz{at}nsi.edu

Read the Full Text


THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES:
Dynamic Encoding of Movement Direction in Motor Cortical Neurons.
J. Rickert, A. Riehle, A. Aertsen, S. Rotter, and M. P. Nawrot (2009)
J. Neurosci. 29, 13870-13882
   Abstract »    Full Text »    PDF »
Adaptation to Visuomotor Rotation Through Interaction Between Posterior Parietal and Motor Cortical Areas.
H. Tanaka, T. J. Sejnowski, and J. W. Krakauer (2009)
J Neurophysiol 102, 2921-2932
   Abstract »    Full Text »    PDF »
Cortical Representation of Ipsilateral Arm Movements in Monkey and Man.
K. Ganguly, L. Secundo, G. Ranade, A. Orsborn, E. F. Chang, D. F. Dimitrov, J. D. Wallis, N. M. Barbaro, R. T. Knight, and J. M. Carmena (2009)
J. Neurosci. 29, 12948-12956
   Abstract »    Full Text »    PDF »
A Robotic Neural Interface for Autonomous Positioning of Extracellular Recording Electrodes.
M. T. Wolf, J. G. Cham, E. A. Branchaud, G. H. Mulliken, J. W. Burdick, and R. A. Andersen (2009)
The International Journal of Robotics Research 28, 1240-1256
   Abstract »    PDF »
Attention Improves Object Representation in Visual Cortical Field Potentials.
D. Rotermund, K. Taylor, U. A. Ernst, A. K. Kreiter, and K. R. Pawelzik (2009)
J. Neurosci. 29, 10120-10130
   Abstract »    Full Text »    PDF »
Factor-Analysis Methods for Higher-Performance Neural Prostheses.
G. Santhanam, B. M. Yu, V. Gilja, S. I. Ryu, A. Afshar, M. Sahani, and K. V. Shenoy (2009)
J Neurophysiol 102, 1315-1330
   Abstract »    Full Text »    PDF »
Hand Posture Subspaces for Dexterous Robotic Grasping.
M. T. Ciocarlie and P. K. Allen (2009)
The International Journal of Robotics Research 28, 851-867
   Abstract »    PDF »
Multitasking of Attention and Memory Functions in the Primate Prefrontal Cortex.
A. Messinger, M. A. Lebedev, J. D. Kralik, and S. P. Wise (2009)
J. Neurosci. 29, 5640-5653
   Abstract »    Full Text »    PDF »
Functional network reorganization during learning in a brain-computer interface paradigm.
B. Jarosiewicz, S. M. Chase, G. W. Fraser, M. Velliste, R. E. Kass, and A. B. Schwartz (2008)
PNAS 105, 19486-19491
   Abstract »    Full Text »    PDF »
Toward Optimal Target Placement for Neural Prosthetic Devices.
J. P. Cunningham, B. M. Yu, V. Gilja, S. I. Ryu, and K. V. Shenoy (2008)
J Neurophysiol 100, 3445-3457
   Abstract »    Full Text »    PDF »
Unique Cortical Physiology Associated With Ipsilateral Hand Movements and Neuroprosthetic Implications.
K. J. Wisneski, N. Anderson, G. Schalk, M. Smyth, D. Moran, and E. C. Leuthardt (2008)
Stroke 39, 3351-3359
   Abstract »    Full Text »    PDF »
Decoding Trajectories from Posterior Parietal Cortex Ensembles.
G. H. Mulliken, S. Musallam, and R. A. Andersen (2008)
J. Neurosci. 28, 12913-12926
   Abstract »    Full Text »    PDF »
Advanced Neurotechnologies for Chronic Neural Interfaces: New Horizons and Clinical Opportunities.
D. R. Kipke, W. Shain, G. Buzsaki, E. Fetz, J. M. Henderson, J. F. Hetke, and G. Schalk (2008)
J. Neurosci. 28, 11830-11838
   Full Text »    PDF »
Detecting Neural-State Transitions Using Hidden Markov Models for Motor Cortical Prostheses.
C. Kemere, G. Santhanam, B. M. Yu, A. Afshar, S. I. Ryu, T. H. Meng, and K. V. Shenoy (2008)
J Neurophysiol 100, 2441-2452
   Abstract »    Full Text »    PDF »
Learning a Novel Myoelectric-Controlled Interface Task.
S. M. Radhakrishnan, S. N. Baker, and A. Jackson (2008)
J Neurophysiol 100, 2397-2408
   Abstract »    Full Text »    PDF »
Turning Thought into Action.
L. R. Hochberg (2008)
N. Engl. J. Med. 359, 1175-1177
   Full Text »    PDF »
Probability-Based Prediction of Activity in Multiple Arm Muscles: Implications for Functional Electrical Stimulation.
C. V. Anderson and A. J. Fuglevand (2008)
J Neurophysiol 100, 482-494
   Abstract »    Full Text »    PDF »
The Cortical Control of Visually Guided Grasping.
U. Castiello and C. Begliomini (2008)
Neuroscientist 14, 157-170
   Abstract »    PDF »
Stimuli-Responsive Polymer Nanocomposites Inspired by the Sea Cucumber Dermis.
J. R. Capadona, K. Shanmuganathan, D. J. Tyler, S. J. Rowan, and C. Weder (2008)
Science 319, 1370-1374
   Abstract »    Full Text »    PDF »
Think to Move: a Neuromagnetic Brain-Computer Interface (BCI) System for Chronic Stroke.
E. Buch, C. Weber, L. G. Cohen, C. Braun, M. A. Dimyan, T. Ard, J. Mellinger, A. Caria, S. Soekadar, A. Fourkas, et al. (2008)
Stroke 39, 910-917
   Abstract »    Full Text »    PDF »
Coordinate Transformation is First Completed Downstream of Primary Motor Cortex.
Y. Yanai, N. Adamit, Z. Israel, R. Harel, and Y. Prut (2008)
J. Neurosci. 28, 1728-1732
   Abstract »    Full Text »    PDF »
Hand Movement Direction Decoded from MEG and EEG.
S. Waldert, H. Preissl, E. Demandt, C. Braun, N. Birbaumer, A. Aertsen, and C. Mehring (2008)
J. Neurosci. 28, 1000-1008
   Abstract »    Full Text »    PDF »
Decoding of Temporal Intervals From Cortical Ensemble Activity.
M. A. Lebedev, J. E. O'Doherty, and M. A. L. Nicolelis (2008)
J Neurophysiol 99, 166-186
   Abstract »    Full Text »    PDF »
Recording Chronically From the Same Neurons in Awake, Behaving Primates.
A. S. Tolias, A. S. Ecker, A. G. Siapas, A. Hoenselaar, G. A. Keliris, and N. K. Logothetis (2007)
J Neurophysiol 98, 3780-3790
   Abstract »    Full Text »    PDF »
Biomimetic Brain Machine Interfaces for the Control of Movement.
A. H. Fagg, N. G. Hatsopoulos, V. de Lafuente, K. A. Moxon, S. Nemati, J. M. Rebesco, R. Romo, S. A. Solla, J. Reimer, D. Tkach, et al. (2007)
J. Neurosci. 27, 11842-11846
   Abstract »    Full Text »    PDF »
Single-Neuron Stability during Repeated Reaching in Macaque Premotor Cortex.
C. A. Chestek, A. P. Batista, G. Santhanam, B. M. Yu, A. Afshar, J. P. Cunningham, V. Gilja, S. I. Ryu, M. M. Churchland, and K. V. Shenoy (2007)
J. Neurosci. 27, 10742-10750
   Abstract »    Full Text »    PDF »
General-Purpose Filter Design for Neural Prosthetic Devices.
L. Srinivasan, U. T. Eden, S. K. Mitter, and E. N. Brown (2007)
J Neurophysiol 98, 2456-2475
   Abstract »    Full Text »    PDF »
Decoding Visual Inputs From Multiple Neurons in the Human Temporal Lobe.
R. Q. Quiroga, L. Reddy, C. Koch, and I. Fried (2007)
J Neurophysiol 98, 1997-2007
   Abstract »    Full Text »    PDF »
Predicting Movement from Multiunit Activity.
E. Stark and M. Abeles (2007)
J. Neurosci. 27, 8387-8394
   Abstract »    Full Text »    PDF »
Reply to Kurtzer and Herter.
A. P. Georgopoulos, T. Naselaris, H. Merchant, and B. Amirikian (2007)
J Neurophysiol 97, 4391-4392
   Full Text »    PDF »
Temporal Complexity and Heterogeneity of Single-Neuron Activity in Premotor and Motor Cortex.
M. M. Churchland and K. V. Shenoy (2007)
J Neurophysiol 97, 4235-4257
   Abstract »    Full Text »    PDF »
Motor Cortical Representation of Position and Velocity During Reaching.
W. Wang, S. S. Chan, D. A. Heldman, and D. W. Moran (2007)
J Neurophysiol 97, 4258-4270
   Abstract »    Full Text »    PDF »
Primate Reaching Cued by Multichannel Spatiotemporal Cortical Microstimulation.
N. A. Fitzsimmons, W. Drake, T. L. Hanson, M. A. Lebedev, and M. A. L. Nicolelis (2007)
J. Neurosci. 27, 5593-5602
   Abstract »    Full Text »    PDF »
Mixture of Trajectory Models for Neural Decoding of Goal-Directed Movements.
B. M. Yu, C. Kemere, G. Santhanam, A. Afshar, S. I. Ryu, T. H. Meng, M. Sahani, and K. V. Shenoy (2007)
J Neurophysiol 97, 3763-3780
   Abstract »    Full Text »    PDF »
Explaining Patterns of Neural Activity in the Primary Motor Cortex Using Spinal Cord and Limb Biomechanics Models.
E. Trainin, R. Meir, and A. Karniel (2007)
J Neurophysiol 97, 3736-3750
   Abstract »    Full Text »    PDF »
Brain-computer interfaces: communication and restoration of movement in paralysis.
N. Birbaumer and L. G. Cohen (2007)
J. Physiol. 579, 621-636
   Abstract »    Full Text »    PDF »
Volitional control of neural activity: implications for brain-computer interfaces.
E. E. Fetz (2007)
J. Physiol. 579, 571-579
   Abstract »    Full Text »    PDF »
Brain-computer interfaces as new brain output pathways.
J. R. Wolpaw (2007)
J. Physiol. 579, 613-619
   Abstract »    Full Text »    PDF »
Useful signals from motor cortex.
A. B. Schwartz (2007)
J. Physiol. 579, 581-601
   Abstract »    Full Text »    PDF »
Direct Comparison of the Task-Dependent Discharge of M1 in Hand Space and Muscle Space.
M. M. Morrow, L. R. Jordan, and L. E. Miller (2007)
J Neurophysiol 97, 1786-1798
   Abstract »    Full Text »    PDF »
Partial Reconstruction of Muscle Activity From a Pruned Network of Diverse Motor Cortex Neurons.
M. H. Schieber and G. Rivlis (2007)
J Neurophysiol 97, 70-82
   Abstract »    Full Text »    PDF »
Correlations Between the Same Motor Cortex Cells and Arm Muscles During a Trained Task, Free Behavior, and Natural Sleep in the Macaque Monkey.
A. Jackson, J. Mavoori, and E. E. Fetz (2007)
J Neurophysiol 97, 360-374
   Abstract »    Full Text »    PDF »
Neural Internet: Web Surfing with Brain Potentials for the Completely Paralyzed.
A. A. Karim, T. Hinterberger, J. Richter, J. Mellinger, N. Neumann, H. Flor, A. Kubler, and N. Birbaumer (2006)
Neurorehabil Neural Repair 20, 508-515
   Abstract »    PDF »
Large-Scale Organization of Preferred Directions in the Motor Cortex. I. Motor Cortical Hyperacuity for Forward Reaching.
T. Naselaris, H. Merchant, B. Amirikian, and A. P. Georgopoulos (2006)
J Neurophysiol 96, 3231-3236
   Abstract »    Full Text »    PDF »
Large-Scale Organization of Preferred Directions in the Motor Cortex. II. Analysis of Local Distributions.
T. Naselaris, H. Merchant, B. Amirikian, and A. P. Georgopoulos (2006)
J Neurophysiol 96, 3237-3247
   Abstract »    Full Text »    PDF »
Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity.
Y. Loewenstein and H. S. Seung (2006)
PNAS 103, 15224-15229
   Abstract »    Full Text »    PDF »
Effects of Noise Correlations on Information Encoding and Decoding.
B. B. Averbeck and D. Lee (2006)
J Neurophysiol 95, 3633-3644
   Abstract »    Full Text »    PDF »
Remapping Hand Movements in a Novel Geometrical Environment.
K. M. Mosier, R. A. Scheidt, S. Acosta, and F. A. Mussa-Ivaldi (2005)
J Neurophysiol 94, 4362-4372
   Abstract »    Full Text »    PDF »
Stable Ensemble Performance with Single-Neuron Variability during Reaching Movements in Primates.
J. M. Carmena, M. A. Lebedev, C. S. Henriquez, and M. A. L. Nicolelis (2005)
J. Neurosci. 25, 10712-10716
   Abstract »    Full Text »    PDF »
Motor Cortex Neural Correlates of Output Kinematics and Kinetics During Isometric-Force and Arm-Reaching Tasks.
L. E. Sergio, C. Hamel-Paquet, and J. F. Kalaska (2005)
J Neurophysiol 94, 2353-2378
   Abstract »    Full Text »    PDF »
Encoding of Movement Direction in Different Frequency Ranges of Motor Cortical Local Field Potentials.
J. Rickert, S. C. de Oliveira, E. Vaadia, A. Aertsen, S. Rotter, and C. Mehring (2005)
J. Neurosci. 25, 8815-8824
   Abstract »    Full Text »    PDF »
Rapid Reshaping of Human Motor Generalization.
K. A. Thoroughman and J. A. Taylor (2005)
J. Neurosci. 25, 8948-8953
   Abstract »    Full Text »    PDF »
Statistical Issues in the Analysis of Neuronal Data.
R. E. Kass, V. Ventura, and E. N. Brown (2005)
J Neurophysiol 94, 8-25
   Abstract »    Full Text »    PDF »
Neurons in the Rostral Cingulate Motor Area Monitor Multiple Phases of Visuomotor Behavior With Modest Parametric Selectivity.
E. Hoshi, H. Sawamura, and J. Tanji (2005)
J Neurophysiol 94, 640-656
   Abstract »    Full Text »    PDF »
Cortical Ensemble Adaptation to Represent Velocity of an Artificial Actuator Controlled by a Brain-Machine Interface.
M. A. Lebedev, J. M. Carmena, J. E. O'Doherty, M. Zacksenhouse, C. S. Henriquez, J. C. Principe, and M. A. L. Nicolelis (2005)
J. Neurosci. 25, 4681-4693
   Abstract »    Full Text »    PDF »
Redundancy and Synergy of Neuronal Ensembles in Motor Cortex.
N. S. Narayanan, E. Y. Kimchi, and M. Laubach (2005)
J. Neurosci. 25, 4207-4216
   Abstract »    Full Text »    PDF »
Parietal Representation of Hand Velocity in a Copy Task.
B. B. Averbeck, M. V. Chafee, D. A. Crowe, and A. P. Georgopoulos (2005)
J Neurophysiol 93, 508-518
   Abstract »    Full Text »    PDF »
Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans.
J. R. Wolpaw and D. J. McFarland (2004)
PNAS 101, 17849-17854
   Abstract »    Full Text »    PDF »
Coding of position by simultaneously recorded sensory neurones in the cat dorsal root ganglion.
R. B Stein, D. J Weber, Y Aoyagi, A Prochazka, J. B. M Wagenaar, S Shoham, and R. A Normann (2004)
J. Physiol. 560, 883-896
   Abstract »    Full Text »    PDF »
Decoding Continuous and Discrete Motor Behaviors Using Motor and Premotor Cortical Ensembles.
N. Hatsopoulos, J. Joshi, and J. G. O'Leary (2004)
J Neurophysiol 92, 1165-1174
   Abstract »    Full Text »    PDF »
Cognitive Control Signals for Neural Prosthetics.
S. Musallam, B. D. Corneil, B. Greger, H. Scherberger, and R. A. Andersen (2004)
Science 305, 258-262
   Abstract »    Full Text »    PDF »
Hand function: peripheral and central constraints on performance.
M. H. Schieber and M. Santello (2004)
J Appl Physiol 96, 2293-2300
   Abstract »    Full Text »    PDF »
Recursive Bayesian Decoding of Motor Cortical Signals by Particle Filtering.
A. E. Brockwell, A. L. Rojas, and R. E. Kass (2004)
J Neurophysiol 91, 1899-1907
   Abstract »    Full Text »    PDF »
Spatiotemporal Tuning of Motor Cortical Neurons for Hand Position and Velocity.
L. Paninski, M. R. Fellows, N. G. Hatsopoulos, and J. P. Donoghue (2004)
J Neurophysiol 91, 515-532
   Abstract »    Full Text »
Chronic, multisite, multielectrode recordings in macaque monkeys.
M. A. L. Nicolelis, D. Dimitrov, J. M. Carmena, R. Crist, G. Lehew, J. D. Kralik, and S. P. Wise (2003)
PNAS 100, 11041-11046
   Abstract »    Full Text »    PDF »
Editorial Comment--Functional MRI: A Potential Physiologic Indicator for Stroke Rehabilitation Interventions.
B. H. Dobkin (2003)
Stroke 34 , e26-e28
   Full Text »
Prediction of Muscle Activity by Populations of Sequentially Recorded Primary Motor Cortex Neurons.
M. M. Morrow and L. E. Miller (2003)
J Neurophysiol 89, 2279-2288
   Abstract »    Full Text »    PDF »


To Advertise     Find Products

Science. ISSN 0036-8075 (print), 1095-9203 (online)