Document Type : Full Research Paper


1 M.Sc Graduated, Medical Image Processing Lab., School of Electrical Engineering, Iran University of Science and Technology

2 Assistant Professor, School of Electrical Engineering, Iran University of Science and Technology

3 Assistant Professor, Rajaei Cardiovascular Medical and Research Center, Tehran University of Medical Sciences



Dimensionality reduction is an important task in machine learning, to simplify data mining, image processing, classification and visualization of high-dimensional data by mitigating undesired properties of high-dimensional spaces. Manifold learning is a relatively new approach to nonlinear dimensionality reduction. Algorithms for manifold learning are based on the intuition that the dimensionality of many data sets may be artificially high and each data point can be described as a function of only a few underlying parameters. Using this tool, intrinsic parameters of the system database, which are main distinction factors of data sets, are recognized and all of them lie on a manifold that shows the real relationship of parameters. One of the successful applications of these methods is in image analysis field. By this approach, each image is a data in high dimensional space that the pixels are its dimensions. Because echocardiography images obtained from a patient are different in quantitative parameters such as heartbeat periodic motion and noise, image sets are reduced to two-dimensional space by a proper manifold learning. In this article, after mapping echocardiography images in two-dimensional space, by using LLE and Isomap algorithms, similar images placed side by side and the relationships between the images according to the cyclic property of heartbeat became evident. The Results showed the weakness of Isomap algorithm and power of LLE algorithm in preserving the relation between consecutive frames. De-noising is an important application which extracted from this research.


Main Subjects

[1]      Tenenbaum J.B., Silva V., and Langford J., A global geometric framework for nonlinear dimensionality reduction, Science, 2000; 290: 2319–2323.
[2]      Roweis S.T., and Saul L.K., Nonlinear dimensionality reduction by locally linear embedding, Science, 2000; 290:2323-2326.
[3]      Saul L. and Roweis S., Think globally, fit locally: unsupervised learning of low dimensional manifolds, Journal of Machine Learning Research., 2003; 4: 119–155.
[4]      Hotelling H., Analysis of a complex of statistical variables into principal components. Journal of Educational Psychology, 1933; 24: 417–441.
[5]      Cox T. and Cox M., Multidimensional scaling. Chapman & Hall, 1994.
[6]      Lafon S. and Lee A..B., Diffusion maps and coarse-graining: A unified framework for dimensionality reduction, graph partitioning, and data set parameterization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006; 28(9): 1393–1403.
[7]      Belkin M. and Niyogi P., Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering, Neural Information Processing Systems, 2002; 14: 585-591.
[8]      Donoho D.L. and Grimes C., Hessian eigenmaps: New locally linear embedding techniques for high-dimensional data, Proceedings of the National Academy of Sciences, 2005; 102 (21): 7426–7431.
[9]      Dixon M., acobs N.J. and Pless R., Finding Minimal Parameterizations of Cylindrical Image Manifolds, IEEE transaction on Computer Vision and pattern recognition, 2006; 7: 192-200.
[10]   Zhang Q., Souvenir R. and Pless R., Segmentation Informed by Manifold Learning, Lecture Notes in Computer Science(LNCS), Springer, 2005; 3757:398-413.
[11]   Souvenir R., Pless R., Image distance functions for manifold learning, Image and Vision Computing, 2007; 25(3): 365-373.
[12]   Kumar V., Grama A., Gupta A., Karypis G., Introduction to Parallel Computing: Design and Analysis of Algorithms, 1994: 257-297.
[13]   Gifani, P., Behnam, H., Shalbaf, A., and Sani, Z. A., Automatic detection of end-diastole and end-systole from echocardiography images using manifold learning, Physiol. Meas, 2010; 31: 1091–1103.
[14]   Goodman J. W., Some fundamental properties of speckle, J. Opt. Soc. Amer, 1976; 66: 1145-1150.
[15]   Loupas T., McDicken W., and Allan P., An adaptive weighted median filter for speckle suppression in medical ultrasonic images, IEEE Transactions on Circuits and Systems, 1989; 36: 129–135.
[16]   Jain A. K., Fundamental of Digital Image Processing. NJ: Prentice-Hall, 1989.
[17]   Frost V. S, Stiles J. A., Shanmugan K. S, and Holtzman J. C., A model for radar images and its application to adaptive digital filtering of multiplicative noise, IEEE Trans. Pattern Anal. Machine Intell., 1982;4: 157–165.