Object Classification Method Using Dynamic Random Forests and Genetic Optimization

다국어 초록 (Multilingual Abstract)

In this paper, we proposed the object classification method using genetic and dynamic random forest consisting of optimal combination of unit tree. The random forest can ensure good generalization performance in combination of large amount of trees by assigning the randomization to the training samples and feature selection, etc. allocated to the decision tree as an ensemble classification model which combines with the unit decision tree based on the bagging. However, the random forest is composed of unit trees randomly, so it can show the excellent classification performance only when the sufficient amounts of trees are combined. There is no quantitative measurement method for the number of trees, and there is no choice but to repeat random tree structure continuously. The proposed algorithm is composed of random forest with a combination of optimal tree while maintaining the generalization performance of random forest. To achieve this, the problem of improving the classification performance was assigned to the optimization problem which found the optimal tree combination. For this end, the genetic algorithm methodology was applied. As a result of experiment, we had found out that the proposed algorithm could improve about 3~5% of classification performance in specific cases like common database and self infrared database compare with the existing random forest. In addition, we had shown that the optimal tree combination was decided at 55~60% level from the maximum trees.

목차 (Table of Contents)

• Abstract
• Ⅰ. Introduction
• Ⅱ. Random Forests
• Ⅲ. Genetic Algorithm
• Ⅳ. The Proposed Algorithm
• Ⅴ. Experimental Results
• Ⅵ. Conclusions
• REFERENCES

참고문헌 (Reference)

1 김재협, "적외선 영상에서의 시계열 특징 추출을 이용한 Gunnery 분류 기법 연구" 한국컴퓨터정보학회 19 (19): 43-53, 2014

2 강선경, "인공신경망을 이용한 마커 검출 및 인식의 정확도 개선" 한국컴퓨터정보학회 13 (13): 89-98, 2008

3 정경중, "얼굴정렬과 AdaBoost를 이용한 얼굴 표정 인식" 대한전자공학회 51 (51): 193-202, 2014

4 김재협, "아이다부스트(Adaboost)와 원형기반함수를 이용한다중표적 분류 기법" 대한전자공학회 47 (47): 22-28, 2010

5 허기수, "신경망의 노드 가지치기를 위한 유전 알고리즘" 대한전자공학회 46 (46): 65-74, 2009

6 염해영, "소속 함수와 유전자 정보의 신경망을 이용한 유전자 타입의 분류" 대한전자공학회 42 (42): 251-260, 2005

7 김광성, "불균형 데이터 학습을 위한 지지벡터기계 알고리즘" 한국컴퓨터정보학회 15 (15): 11-17, 2010

8 "http://archive.ics.uci.edu/ml/"

9 P. Viola, "Robust real-time face detection" 57 (57): 137-154, 2004

10 L. Breiman, "Random forest" 45 : 5-32, 2001

11 D. E. Rumelhart, "Parallel distributed processing: explorations in the microstructure of cognition" MIT Press 1986

12 김철문, "PCA 복원과 HOG 특징 기술자 기반의 효율적인보행자 인식 방법" 대한전자공학회 50 : 162-170, 2013

13 S. Bernard, "On the selection of decision trees in random forest" 302-307, 2009

14 F. Roli, "Methods for designing multiple classifier systems" 78-87, 2001

15 S. Bernard, "Influence of hyperparameters on random forest accuracy" 1 : 171-180, 2009

16 I. S. Oh, "Hybrid genetic algorithms for feature selection" 26 (26): 1424-1437, 2004

17 Robi Polikar, "Ensemble based systems in decision making" 6 (6): 21-45, 2006

18 S. Bernard, "Dynamic random forests" 33 (33): 1580-1586, 2012

19 E. Tripoli, "Dynamic construction of random forests: Evaluation using biomedical engineering problems" 1 : 3-5, 2010

20 L. Breiman, "Chapman and Hall"

21 R. Maclin, "Boosting Classifiers Regionally" 1 : 700-705, 1998

22 T. G. Dietterich, "An experimental comparison of three methods for constructing ensembles of decision trees : bagging, boosting, and randomization" 40 (40): 139-157, 2010

23 C. J. C. Burges, "A tutorial on support vector machines for pattern recognition" 2 : 121-167, 1998

24 Venkatadri M., "A multiobjective genetic algorithm for feature selection in data mining" 1 (1): 443-448, 2010

25 R. Banfield, "A comparison of ensemble creation technique" 1 : 223-232, 2004