광류와 표정 HMM에 의한 동영상으로부터의 실시간 얼굴표정 인식 = Realtime Facial Expression Recognition from Video Sequences Using Optical Flow and Expression HMM

다국어 초록 (Multilingual Abstract)

Vision-based Human computer interaction is an emerging field of science and industry to provide natural way to communicate with human and computer. In that sense, inferring the emotional state of the person based on the facial expression recognition is an important issue. In this paper, we present a novel approach to recognize facial expression from a sequence of input images using emotional specific HMM (Hidden Markov Model) and facial motion tracking based on optical flow. Conventionally, in the HMM which consists of basic emotional states, it is considered natural that transitions between emotions are imposed to pass through neutral state. However, in this work we propose an enhanced transition framework model which consists of transitions between each emotional state without passing through neutral state in addition to a traditional transition model. For the localization of facial features from video sequence we exploit template matching and optical flow. The facial feature displacements traced by the optical flow are used for input parameters to HMM for facial expression recognition. From the experiment, we can prove that the proposed framework can effectively recognize the facial expression in real time.

참고문헌 (Reference)

1 Y. Zhu, "Using Moment Invariants and HMM in Facial Expression Recognition" 23 : 83-91, 2002

2 J.L. Barron, "Tutorial: Computing 2D and 3D Optical Flow" 2005

3 M. Evgeny, "Tracking Facial Features with Occlusions" 7 (7): 1282-1288, 2006

4 M. Black, "Robust incremental optical flow" Yale University 1992

5 P. Michel, "Real Time Facial Expression Recognition in Video using Support Vector Machines" 258-264, 2003

6 Philipp Michel, "Real Time Facial Expression Recognition in Video using Support Vector Machines" 258-264, 2003

7 A.V. Nefian, "Maximum Likelihood Training of The Embedded HMM for Face Detection and Recognition" 10-13, 2000

8 Ara V. Nefian, "Hidden Markov Models for Face Recognition" 2721-2724, 1998

9 I. Cohen, "Facial expression recognition from video sequences: temporal and static modeling" 91 : 160-187, 2003

10 C.C Chien, "Facial Expression Analysis Under Various Head Poses" 16-18, 2002

11 Pardas, "Facial Animation Parameters Extraction and Expression Recognition Using Hidden Markov Models" 17 : 675-688, 2002

12 P. Ekman, "Facial Action Coding System (FACS)" Consulting Psychologist Press 1978

13 J. Huang, "Face Recognition with Support Vector Machines and 3D Head Models" 334-341, 2002

14 B. Fasel, "Automatic Facial Expression Analysis" 36 (36): 259-275, 2003

15 Y. Zhu, "A Solution for Facial Expression Representation, and Recognition" 17 : 657-673, 2002

16 J.C Chun, "A Robust 3D Face Pose Estimation and Facial Expression Control for Vision-Based Animation" 4351 : 700-708, 2007

17 K. Anderson, "A Real-Time Automated System for The Recognition of Human Facial Expressions" 36 (36): 96-105, 2006

18 K.P. Min, "A Nonparametric Skin Color Model for Face Detection from Color Images" 3320 : 115-119, 2004

19 Hong-Zhong Huang, "A Comparison Study of Support Vector Machines and Hidden Markov Models in Machinery Condition Monitoring" 대한기계학회 21 (21): 607-615, 2007