선형적 특징추출 방법의 특성 비교

국문 초록 (Abstract)

이 논문은 고차원의 데이터를 저차원으로 줄이는 방법 중 하나인 특징추출에 대한 방법들의 특성을 비교한다. 비교대상 방법은 전통적인 PCA(Principal Component Analysis)방법과 시각피질의 특성을 보인다고 알려진 ICA(Independent Component Analysis), 국소기반인식을 구현한 NMF(Non-negative Matrix Factorization), 그리고 이의 성능을 개선한 sNMF(Sparse NMF)로 정하였다. 추출된 특징들의 특성을 시각적으로 확인하기 위하여 필기체 숫자 영상을 대상으로 특징추출을 수행하였으며, 인식기에 적용한 효과의 확인을 위하여 추출된 특징을 다층퍼셉트론에 학습시켜보았다. 각 방법의 특성을 비교한 결과는 응용하고자 하는 문제에서 어떤 특징을 추출하기 원하느냐에 따라 특징추출 방법을 선정할 때 유용할 것이다.

다국어 초록 (Multilingual Abstract)

In this paper, feature extraction methods, which is one field of reducing dimensions of high-dimensional data, are empirically investigated. We selected the traditional PCA(Principal Component Analysis), ICA(Independent Component Analysis), NMF(Non-negative Matrix Factorization), and sNMF(Sparse NMF) for comparisons. ICA has a similar feature with the simple cell of V1. NMF implemented a parts-based representation in the brain and sNMF is a improved version of NMF. In order to visually investigate the extracted features, handwritten digits are handled. Also, the extracted features are used to train multi-layer perceptrons for recognition test. The characteristic of each feature extraction method will be useful when applying feature extraction methods to many real-world problems.

목차 (Table of Contents)

• 요약
• Abstract
• Ⅰ. 서론
• Ⅱ. 선형적 특징추출 방법들
• Ⅲ. 시뮬레이션
• Ⅳ. 결론
• 참고문헌
• 저자소개

참고문헌 (Reference)

1 A. J. Bell, "The independent components of natural scenes are edge filters" 37 : 3327-3338, 1997

2 E. Doi, "Spatiochromatic receptive field properties derived from information-theoretic analyses of cone mosaic responses to natural scenes" 15 : 397-417, 2003

3 H. Kim, "Sparse non-negative matrix factorizations via alternating non-negativity -constrained least squares for microarray data analysis" 1495-1502, 2007

4 S. T. Roweis, "Nonlinear dimensionality reduction by locally linear embedding" 290 (290): 2323-2326, 2000

5 S. Amari, "Natural gradient works efficiently in learning" 10 : 251-276, 1998

6 D. D. Lee, "Learning the parts of objects by non-negative matrix factorization" 401 : 788-791, 1999

7 Keinosuke Fukunaga, "Introduction to Statistical Pattern Recognition" Elsevier 1990

8 S.-H. Oh, "Improving the error back- propagation algorithm with a modified error function" 8 : 799-803, 1997

9 J.-M. Alonso, "Functioanl connectivity between simple cells and complex cells in cat striate cortex" 1 (1): 395-403, 1998

10 J. Ye, "Feature reduction via generalizaed uncrrelated linear discriment analysis" 18 : 1312-1322, 2006

11 T.-W. Lee, "A unfying information -theoretic framework for independent component analysis" 31 : 1-21, 2000

12 J. B. Tenenbaum, "A global geometric framework for nonlinear dimensionality reduction" 290 (290): 2319-2323, 2000

13 J. J. Hull, "A database for handwritten text recognition research" 16 : 550-554, 1994