멀티모달 실감 경험 I/O 인터랙션 시스템 개발 = Development for Multi-modal Realistic Experience I/O Interaction System

다국어 초록 (Multilingual Abstract)

The purpose of this study is to develop the multi-modal interaction system. This system provides realistic and an immersive experience through multi-modal interaction. The system recognizes user behavior, intention, and attention, which overcomes the limitations of uni-modal interaction. The multi-modal interaction system is based upon gesture interaction methods, intuitive gesture interaction and attention evaluation technology. The gesture interaction methods were based on the sensors that were selected to analyze the accuracy of the 3-D gesture recognition technology using meta-analysis. The elements of intuitive gesture interaction were reflected through the results of experiments. The attention evaluation technology was developed by the physiological signal analysis. This system is divided into 3 modules; a motion cognitive system, an eye gaze detecting system, and a bio-reaction sensing system. The first module is the motion cognitive system which uses the accelerator sensor and flexible sensors to recognize hand and finger movements of the user. The second module is an eye gaze detecting system that detects pupil movements and reactions. The final module consists of a bio-reaction sensing system or attention evaluating system which tracks cardiovascular and skin temperature reactions. This study will be used for the development of realistic digital entertainment technology.

참고문헌 (Reference)

1 Kim, J. H, "research on attentive gaze by physiological signal" 160-163, 2009

2 Green,S, "Systematic reviews and meta-analysis" 46 (46): 270-, 2005

3 Cho, C. W., "Robust gaze-tracking method by using frontal-viewing and eye-tracking cameras" 48 (48): 127202- 1-127202-15, 2009

4 Oviatt, S, "Perceptual user interfaces: multimodal interfaces that process what comes naturally" 43 (43): 45-53, 2000

5 Bang, J. W, "New Computer Interface Combining Gaze Tracking and Brainwave Measurements" 2011

6 Reeves, L. M, "Guidelines for multimodal user interface design" 47 (47): 57-59, 2004

7 Cho, C. W, "Gaze tracking method as an IPTV interface based on support vector regression" 2011

8 Lee, H. C, "Gaze Tracking System at a Distance for Controlling IPTV" IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC 56 (56): 2577-2583, 2010

9 Lee, E. C, "Experimental Investigations of Pupil Accommodation Factors" ASSOC RESEARCH VISION OPHTHALMOLOGY INC 52 (52): 6478-6485, 2011

10 Gonzalez, R. C, "Digital Image Processing, 2nd ed" Prentice Hall 2003

11 Kim, Y. W, "Analysis of 3D motion recognition accuracy using meta-analysis for interaction" 153-159, 2009

12 Ko, Y. J, "A robust gaze detection method by compensating for facial movements based on corneal specularities" ELSEVIER SCIENCE BV 29 (29): 1474-1485, 2008

13 Heo, H, "A realistic game system using multi-modal user interfaces, IEEE Trans" 56 (56): 1364-1372, 2010

14 Lee, E. C, "A brain-computer interface method combined with eye tracking for 3D interaction" ELSEVIER SCIENCE BV 190 (190): 289-298, 2010

15 Kim, Y. W, "A Study on interaction factor in intuitive gesture" 66-69, 2009

16 Korea Creative Content Agency, "2010 White Paper on Korean Games, Korea Creative Content Agency(KOCCA)"