PCA알고리즘을 이용한 최적 pRBFNNs 기반 나이트비전 얼굴인식 시스템 설계

오성권,장병희,Oh, Sung-Kwun,Jang, Byoung-Hee 대한전자공학회 2013 전자공학회논문지 Vol.50 No.9

본 연구에서는 PCA알고리즘을 이용한 최적 pRBFNNs 기반 나이트비전 얼굴인식 시스템을 설계 하고자 한다. 조명이 없는 주위 상태 하에서 조도가 낮기 때문에 CCD 카메라를 이용하여 영상을 획득하는 것이 어렵다. 본 논문에서는 낮은 조도에 의해 왜곡된 이미지의 품질을 나이트 비전 카메라와 히스토그램 평활화를 사용하여 향상시킨다. 그리고 얼굴과 비얼굴 이미지 영역 사이에서 얼굴 이미지를 검출하기 위하여 Ada-Boost 알고리즘을 사용한다. 추출된 고차원 특징 데이터를 저차원의 특징 데이터로 변환하기 위하여 데이터 차원축소 기법인 주성분 분석법(Principal Components Analysis; PCA)을 사용한다. 또한 인식 모듈로서 pRBFNNs(Polynomial- based Radial Basis Function Neural Networks) 패턴분류기를 소개한다. 제안된 다항식 기반 RBFNNs은 조건부, 결론부, 추론부 세 가지의 기능적 모듈로 구성되어 있다. 조건부는 FCM (Fuzzy C-means) 클러스터링을 사용하여 입력공간을 분할하고, 결론부는 분할된 로컬 영역을 다항식 함수로 표현한다. 그리고 차분진화 (Differential Evolution; DE) 알고리즘을 사용하여 모델의 파라미터를 최적화 한다. In this study, we propose the design of optimized pRBFNNs-based night vision face recognition system using PCA algorithm. It is difficalt to obtain images using CCD camera due to low brightness under surround condition without lighting. The quality of the images distorted by low illuminance is improved by using night vision camera and histogram equalization. Ada-Boost algorithm also is used for the detection of face image between face and non-face image area. The dimension of the obtained image data is reduced to low dimension using PCA method. Also we introduce the pRBFNNs as recognition module. The proposed pRBFNNs consists of three functional modules such as the condition part, the conclusion part, and the inference part. In the condition part of fuzzy rules, input space is partitioned by using Fuzzy C-Means clustering. In the conclusion part of rules, the connection weights of pRBFNNs is represented as three kinds of polynomials such as linear, quadratic, and modified quadratic. The essential design parameters of the networks are optimized by means of Differential Evolution.

Fuzzy Identification by Means of an Auto-Tuning Algorithm and a Weighted Performance Index

오성권,Oh, Sung-Kwun Korean Institute of Intelligent Systems 1998 한국지능시스템학회논문지 Vol.8 No.6

The study concerns a design procedure of rule-based systems. The proposed rule-based fuzzy modeling implements system structure and parameter identification in the efficient from of "IF..., THEN..." statements, and exploits the theory of system optimization and fuzzy implication rules. The method for rule-based fuzzy modeling concerns the from of the conclusion part of the the rules that can be constant. Both triangular and Gaussian-like membership function are studied. The optimization hinges on an autotuning algorithm that covers as a modified constrained optimization method known as a complex method. The study introduces a weighted performance index (objective function) that helps achieve a sound balance between the quality of results produced for the training and testing set. This methodology sheds light on the role and impact of different parameters of the model on its performance. The study is illustrated with the aid of two representative numerical examples.

클러스터링 방법을 이용한 TSK 퍼지추론 시스템의 설계 및 해석

오성권,Oh, Sung-Kwun 한국정보전자통신기술학회 2014 한국정보전자통신기술학회논문지 Vol.7 No.3

본 논문에서는 주어진 데이터 전처리를 통한 새로운 형태의 TSK기반 퍼지 추론 시스템을 제안한다. 제안된 모델은 주어진 데이터의 효율적인 처리를 위해 클러스터링 기법인 Fuzzy C-Means 클러스터링 방법을 이용하였다. 제안된 새로운 형태의 퍼지추론 시스템의 전반부는 FCM 을 통하여 정규화된 멤버쉽 함수와 클러스터 수를 결정하기 때문에, 멤버쉽함수의 형태 및 개수를 정의할 필요가 없어, 모델의 구조 또한 간단한 형태를 이룬다. 본 논문에서 사용된 후반부는 4가지 형태로-간략추론, 1차선형추론, 2차선형추론, 변형된 2차선형추론-가 있으며, 이는 효율적인 후반부구조를 찾는데 주도적인 역할을 한다. 또한 제안된 모델의 후반부 파라미터 계수는 Weighted Least Squares Estimation(WLSE)을 사용하여 동정하며, Least Squares Estimation(LSE)를 적용한 모델의 성능과 비교한다. 마지막으로, Boston housing 데이터를 사용하여 제안된 모델의 성능을 평가하였다. We introduce a new architecture of TSK-based fuzzy inference system. The proposed model used fuzzy c-means clustering method(FCM) for efficient disposal of data. The premise part of fuzzy rules don't assume any membership function such as triangular, gaussian, ellipsoidal because we construct the premise part of fuzzy rules using FCM. As a result, we can reduce to architecture of model. In this paper, we are able to use four types of polynomials as consequence part of fuzzy rules such as simplified, linear, quadratic, modified quadratic. Weighed Least Square Estimator are used to estimates the coefficients of polynomial. The proposed model is evaluated with the use of Boston housing data called Machine Learning dataset.

데이터 중심 다항식 확장형 RBF 신경회로망의 설계 및 최적화

오성권(Sung-Kwun Oh),김영훈(Young-Hoon Kim),박호성(Ho-Sung Park),김정태(Jeong-Tae Kim) 대한전기학회 2011 전기학회논문지 Vol.60 No.3

In this paper, we introduce a design methodology of data-centroid Radial Basis Function neural networks with extended polynomial function. The two underlying design mechanisms of such networks involve K-means clustering method and Particle Swarm Optimization(PSO). The proposed algorithm is based on K-means clustering method for efficient processing of data and the optimization of model was carried out using PSO. In this paper, as the connection weight of RBF neural networks, we are able to use four types of polynomials such as simplified, linear, quadratic, and modified quadratic. Using K-means clustering, the center values of Gaussian function as activation function are selected. And the PSO-based RBF neural networks results in a structurally optimized structure and comes with a higher level of flexibility than the one encountered in the conventional RBF neural networks. The PSO-based design procedure being applied at each node of RBF neural networks leads to the selection of preferred parameters with specific local characteristics (such as the number of input variables, a specific set of input variables, and the distribution constant value in activation function) available within the RBF neural networks. To evaluate the performance of the proposed data-centroid RBF neural network with extended polynomial function, the model is experimented with using the nonlinear process data(2-Dimensional synthetic data and Mackey-Glass time series process data) and the Machine Learning dataset(NOx emission process data in gas turbine plant, Automobile Miles per Gallon(MPG) data, and Boston housing data). For the characteristic analysis of the given entire dataset with non-linearity as well as the efficient construction and evaluation of the dynamic network model, the partition of the given entire dataset distinguishes between two cases of Division I(training dataset and testing dataset) and Division II(training dataset, validation dataset, and testing dataset). A comparative analysis shows that the proposed RBF neural networks produces model with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.

정압제어를 위한 동적모델 해석 및 최적 퍼지 PID 제어기설계

오성권(Sung-Kwun Oh),조세희(Se-Hee Cho),이승주(Seung-Joo Lee) 대한전기학회 2012 전기학회논문지 Vol.61 No.2

In this study, we introduce a dynamic process model as well as the design methodology of optimized fuzzy controller for its efficient application to vacuum production system to produce a semiconductor, solar module and display and so on. In a vacuum control field, PID control method is widely used from the viewpoint of simple structure and preferred performance. But, PID control method is very sensitive to the change of environment of control system as well as the change of control parameters. Therefore, it’s difficult to get a preferred performance results from target system which has a complicated structure and lots of nonlinear factors. To solve such problem, we propose the design methodology of an optimized fuzzy PID controller through a following series of steps. First a dynamic characteristic of the target system is analyzed through a series of experiments. Second the process model is built up and its characteristic is compared with real process. Third, the optimized fuzzy PID controller is designed using genetic algorithms. Finally, the fuzzy controller is applied to target system and then its performance is compared with that of other conventional controllers(PID, PI, and Fuzzy PI controller). The performance of the proposed fuzzy controller is evaluated in terms of auto-tuned control parameters and output responses considered by ITAE index, overshoot, rise time and steady state time.

공간탐색 진화알고리즘을 이용한 Interval Type-2 pRBF 뉴럴 네트워크의 구조적 해석

오성권(Sung-Kwun Oh),김욱동(Wook-Dong Kim),박호성(Ho-Sung Park),이영일(Young-Il Lee) 한국지능시스템학회 2011 한국지능시스템학회논문지 Vol.21 No.1

본 논문에서는 RBF 뉴럴 네트워크에서 은닉층 활성함수에 Interval type-2 퍼지개념을 적용한 새로운 RBF 뉴럴 네트워크를 설계하였다. 퍼지 시스템 분야에서 불확실한 정보에 대한 Type-1 퍼지집합의 성능을 보안하고자 Type-2 퍼지집합이 제안되었으며, 멤버쉽함수 안에 다시 멤버쉽함수를 생성함으로써 불확실한 정보를 좀 더 효과적으로 다루고자 하였다. 따라서 본 논문에서는 RBF 뉴럴 네트워크의 은닉층 활성함수에 type-2 퍼지집합의 개념을 적용하여 불확실한 정보에 대한 모델 성능을 개선하고자 하였다. 나아가 연결가중치를 상수항이 아닌 1차식으로 구성된 다항식을 사용하여 최종출력을 입력-출력의 관계식으로 표현하였다. 연결가중치는 기존의 경사하강법(Gradient Descent Method; GDM) 대신 conjugate gradient method(CGM)을 사용하여 파라미터를 동조하고, 은닉층의 활성함수는 공간탐색 진화 알고리즘(Space Search Evolutionary Algorithm; SSEA)을 이용하여 가우시안 함수의 중심점 및 분포상수를 동조하여 모델의 성능을 개선시킨다. 제안된 모델의 성능을 평가하기 위해 가스로 시계열 데이터를 사용하였으며, 결과를 기존 모델과 비교하였다. In this paper, we proposed Interval Type-2 polynomial Radial Basis Function Neural Networks. In the receptive filed of hidden layer, Interval Type-2 fuzzy set is used. The characteristic of Interval Type-2 fuzzy set has Footprint Of Uncertainly(FOU), which denotes a certain level of robustness in the presence of un-known information when compared with the type-1 fuzzy set. In order to improve the performance of proposed model, we used the linear polynomial function as connection weight of network. The parameters such as center values of receptive field, constant deviation, and connection weight between hidden layer and output layer are optimized by Conjugate Gradient Method(CGM) and Space Search Evolutionary Algorithm(SSEA). The proposed model is applied to gas furnace dataset and its result are compared with those reported in the previous studies.

최적화된 pRBF 뉴럴 네트워크에 의한 정적 상황 인지 시스템에 관한 연구

오성권(Sung-Kwun Oh),나현석(Hyun-Suk Na),김욱동(Wook-Dong Kim) 대한전기학회 2011 전기학회논문지 Vol.60 No.12

In this paper, we introduce a comprehensive design methodology of Radial Basis Function Neural Networks (RBFNN) that is based on mechanism of clustering and optimization algorithm. We can divide some clusters based on similarity of input dataset by using clustering algorithm. As a result, the number of clusters is equal to the number of nodes in the hidden layer. Moreover, the centers of each cluster are used into the centers of each receptive field in the hidden layer. In this study, we have applied Fuzzy-C Means(FCM) and K-Means(KM) clustering algorithm, respectively and compared between them. The weight connections of model are expanded into the type of polynomial functions such as linear and quadratic. In this reason, the output of model consists of relation between input and output. In order to get the optimal structure and better performance, Particle Swarm Optimization(PSO) is used. We can obtain optimized parameters such as both the number of clusters and the polynomial order of weights connection through structural optimization as well as the widths of receptive fields through parametric optimization. To evaluate the performance of proposed model, NXT equipment offered by National Instrument(NI) is exploited. The situation awareness system-related intelligent model was built up by the experimental dataset of distance information measured between object and diverse sensor such as sound sensor, light sensor, and ultrasonic sensor of NXT equipment.

악천후 상황에서 Laser Range-Gate 방식을 이용한 원거리 영상 감시 및 추적 시스템에 대한 연구

오성권(Sung-Kwun Oh),유성훈(Sung-Hoon Yoo),구경완(Kyong-Wan Ku),김수찬(Su-Chan Kim) 대한전기학회 2013 전기학회논문지 Vol.62 No.2

In case of image observation equipments, CCTV for short distance visual field is usually installed and operated mostly as the means of crime-prevention. However, the extensive demand for monitoring problems in case of the increase in intelligent crimes and disasters has led to the necessity of the development of long-distance observation equipments embedded with Night View functions. In case of the Night View equipments, the relevant market is set up to be focused mostly on Thermal Observation Device(hereinafter, TOD), but some shortcomings such as the limitation of image visibility and excessive maintenance cost, etc. have actually caused the necessity of new long distance Night View equipment. Moreover there might follow lots of difficulties in long-distance visualization in the event that irregular reflection is generated by minute particles in the atmosphere such as fog, smog, and dust, etc. These factors are motivate the work presented in this study. Our study is aimed at the realization of Pulsed Laser Illuminator and newly proposed Range-Gated image acquisition technology. And also the implementation of Tracker for continuous trace of the objects of interest from the obtained sequence images.

데이터 정보입자 기반 퍼지 추론 시스템의 최적화

吳聖權(Sung-Kwun Oh),朴建俊(Keon-Jun Park),李東潤(Dong-Yoon Lee) 대한전기학회 2004 전기학회논문지 D Vol.53 No.6

3차원 얼굴 인식을 위한 PSO와 다중 포인트 특징 추출을 이용한 RBFNNs 패턴분류기 설계

오성권(Sung-Kwun Oh),오승훈(Seung-Hun Oh) 대한전기학회 2014 전기학회논문지 Vol.63 No.6

In this paper, 3D face recognition system is designed by using polynomial based on RBFNNs. In case of 2D face recognition, the recognition performance reduced by the external environmental factors such as illumination and facial pose. In order to compensate for these shortcomings of 2D face recognition, 3D face recognition. In the preprocessing part, according to the change of each position angle the obtained 3D face image shapes are changed into front image shapes through pose compensation. the depth data of face image shape by using Multiple Point Signature is extracted. Overall face depth information is obtained by using two or more reference points. The direct use of the extracted data an high-dimensional data leads to the deterioration of learning speed as well as recognition performance. We exploit principle component analysis(PCA) algorithm to conduct the dimension reduction of high-dimensional data. Parameter optimization is carried out with the aid of PSO for effective training and recognition. The proposed pattern classifier is experimented with and evaluated by using dataset obtained in IC & CI Lab.