Note to users. If you're seeing this message, it means that your browser cannot find this page's style/presentation instructions -- or possibly that you are using a browser that does not support current Web standards. Find out more about why this message is appearing, and what you can do to make your experience of our site the best it can be.
SNM Organization

Site Tools

  • AAAS
  • Subscribe
  • Feedback

Site Search

Search Advanced

Science 22 December 2000:
Vol. 290. no. 5500, pp. 2323 - 2326
DOI: 10.1126/science.290.5500.2323
Prev | Table of Contents

Reports

Nonlinear Dimensionality Reduction by Locally Linear Embedding

Sam T. Roweis,1 and Lawrence K. Saul2

Many areas of science depend on exploratory data analysis and visualization. The need to analyze large amounts of multivariate data raises the fundamental problem of dimensionality reduction: how to discover compact representations of high-dimensional data. Here, we introduce locally linear embedding (LLE), an unsupervised learning algorithm that computes low-dimensional, neighborhood-preserving embeddings of high-dimensional inputs. Unlike clustering methods for local dimensionality reduction, LLE maps its inputs into a single global coordinate system of lower dimensionality, and its optimizations do not involve local minima. By exploiting the local symmetries of linear reconstructions, LLE is able to learn the global structure of nonlinear manifolds, such as those generated by images of faces or documents of text.

1 Gatsby Computational Neuroscience Unit, University College London, 17 Queen Square, London WC1N 3AR, UK.
2 AT&T Lab--Research, 180 Park Avenue, Florham Park, NJ 07932, USA.
E-mail: roweis{at}gatsby.ucl.ac.uk (S.T.R.); lsaul{at}research.att.com (L.K.S.)

Read the Full Text


THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES:
A remark on global positioning from local distances.
A. Singer (2008)
PNAS 105, 9507-9511
   Abstract »    Full Text »    PDF »
A sensorimotor approach to sound localization..
M. Aytekin, C. F. Moss, and J. Z. Simon (2008)
Neural Comput. 20, 603-635
   Abstract »    Full Text »    PDF »
Encoding Network States by Striatal Cell Assemblies.
L. Carrillo-Reid, F. Tecuapetla, D. Tapia, A. Hernandez-Cruz, E. Galarraga, R. Drucker-Colin, and J. Bargas (2008)
J Neurophysiol 99, 1435-1450
   Abstract »    Full Text »    PDF »
Manifold parametrizations by eigenfunctions of the Laplacian and heat kernels.
P. W. Jones, M. Maggioni, and R. Schul (2008)
PNAS 105, 1803-1808
   Abstract »    Full Text »    PDF »
Inaugural Article: A mathematical tool for exploring the dynamics of biological networks.
P. E. Barbano, M. Spivak, M. Flajolet, A. C. Nairn, P. Greengard, and L. Greengard (2007)
PNAS 104, 19169-19174
   Abstract »    Full Text »    PDF »
Natural Variation in RPS2-Mediated Resistance among Arabidopsis Accessions: Correlation between Gene Expression Profiles and Phenotypic Responses.
R. M.P. Van Poecke, M. Sato, L. Lenarz-Wyatt, S. Weisberg, and F. Katagiri (2007)
PLANT CELL 19, 4046-4060
   Abstract »    Full Text »    PDF »
Parametric embedding for class visualization..
T. Iwata, K. Saito, N. Ueda, S. Stromsten, T. L. Griffiths, and J. B. Tenenbaum (2007)
Neural Comput. 19, 2536-2556
   Abstract »    Full Text »    PDF »
Defining functional distance using manifold embeddings of gene ontology annotations.
G. Lerman and B. E. Shakhnovich (2007)
PNAS 104, 11334-11339
   Abstract »    Full Text »    PDF »
Kalman filtering for disease-state estimation from microarray data.
J. Z. Kelemen, A. Kertesz-Farkas, A. Kocsor, and L. G. Puskas (2006)
Bioinformatics 22, 3047-3053
   Abstract »    Full Text »    PDF »
Nonlocal Estimation of Manifold Structure..
Y. Bengio, M. Monperrus, and H. Larochelle (2006)
Neural Comput. 18, 2509-2528
   Abstract »    Full Text »    PDF »
Appearance-Based Topological Bayesian Inference for Loop-Closing Detection in a Cross-Country Environment.
C. Chen and H. Wang (2006)
The International Journal of Robotics Research 25, 953-983
   Abstract »    PDF »
Reducing the dimensionality of data with neural networks..
G. E. Hinton and R. R. Salakhutdinov (2006)
Science 313, 504-507
   Abstract »    Full Text »    PDF »
Visual Characterization of Paper Using Isomap and Local Binary Patterns.
M. TURTINEN, M. PIETIKAINEN, and O. SILVEN (2006)
IEICE Trans D: Information E89-D, 2076-2083
   Abstract »    PDF »
Application of compression-based distance measures to protein sequence classification: a methodological study.
A. Kocsor, A. Kertesz-Farkas, L. Kajan, and S. Pongor (2006)
Bioinformatics 22, 407-412
   Abstract »    Full Text »    PDF »
Generalized multidimensional scaling: A framework for isometry-invariant partial surface matching.
A. M. Bronstein, M. M. Bronstein, and R. Kimmel (2006)
PNAS 103, 1168-1172
   Abstract »    Full Text »    PDF »
Incremental Online Learning in High Dimensions.
S. Vijayakumar, A. D'Souza, and S. Schaal (2005)
Neural Comput. 17, 2602-2634
   Abstract »    Full Text »    PDF »
Non-linear PCA: a missing data approach.
M. Scholz, F. Kaplan, C. L. Guy, J. Kopka, and J. Selbig (2005)
Bioinformatics 21, 3887-3895
   Abstract »    Full Text »    PDF »
Geometric diffusions as a tool for harmonic analysis and structure definition of data: Diffusion maps.
R. R. Coifman, S. Lafon, A. B. Lee, M. Maggioni, B. Nadler, F. Warner, and S. W. Zucker (2005)
PNAS 102, 7426-7431
   Abstract »    Full Text »    PDF »
Bilinear Sparse Coding for Invariant Vision.
D. B. Grimes and R. P. N. Rao (2005)
Neural Comput. 17, 47-73
   Abstract »    Full Text »    PDF »
Temporal Dynamics of Shape Analysis in Macaque Visual Area V2.
J. Hegde and D. C. Van Essen (2004)
J Neurophysiol 92, 3030-3042
   Abstract »    Full Text »    PDF »
Learning Eigenfunctions Links Spectral Embedding and Kernel PCA.
Y. Bengio, O. Delalleau, N. Le Roux, J.-F. Paiement, P. Vincent, and M. Ouimet (2004)
Neural Comput. 16, 2197-2219
   Abstract »    Full Text »    PDF »
Protein ranking: From local to global structure in the protein similarity network.
J. Weston, A. Elisseeff, D. Zhou, C. S. Leslie, and W. S. Noble (2004)
PNAS 101, 6559-6563
   Abstract »    Full Text »    PDF »
Local Context Finder (LCF) reveals multidimensional relationships among mRNA expression profiles of Arabidopsis responding to pathogen infection.
F. Katagiri and J. Glazebrook (2003)
PNAS 100, 10842-10847
   Abstract »    Full Text »    PDF »
Is There Something Out There? Inferring Space from Sensorimotor Dependencies.
D. Philipona, J.K. O'Regan, and J.-P. Nadal (2003)
Neural Comput. 15, 2029-2049
   Abstract »    Full Text »
Computation in a Single Neuron: Hodgkin and Huxley Revisited.
B. A. y Arcas, A. L. Fairhall, and W. Bialek (2003)
Neural Comput. 15, 1715-1749
   Abstract »    Full Text »
Exploring the nonlinear geometry of protein homology.
M. A. Farnum, H. Xu, and D. K. Agrafiotis (2003)
Protein Sci. 12, 1604-1612
   Abstract »    Full Text »    PDF »
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation.
M. Belkin and P. Niyogi (2003)
Neural Comput. 15, 1373-1396
   Abstract »    Full Text »    PDF »
Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data.
D. L. Donoho and C. Grimes (2003)
PNAS 100, 5591-5596
   Abstract »    Full Text »    PDF »
A self-organizing principle for learning nonlinear manifolds.
D. K. Agrafiotis and H. Xu (2002)
PNAS 99, 15869-15872
   Abstract »    Full Text »    PDF »
Sensor-independent stimulus representations.
D. N. Levin (2002)
PNAS 99, 7346-7351
   Abstract »    Full Text »    PDF »
The Isomap Algorithm and Topological Stability.
M. Balasubramanian, E. L. Schwartz, J. B. Tenenbaum, V. de Silva, and J. C. Langford (2002)
Science 295, 7a
   Full Text »    PDF »
Machine Learning for Science: State of the Art and Future Prospects.
E. Mjolsness and D. DeCoste (2001)
Science 293, 2051-2055
   Abstract »    Full Text »    PDF »


ADVERTISEMENT
Click Me!

ADVERTISEMENT
Click Me!

To Advertise     Find Products

Science. ISSN 0036-8075 (print), 1095-9203 (online)