Evaluation of Social Relationship between Two Persons using Micro-movement in Vestibular system

( Sung Teac Hwang ),( Sangin Park ),( Myoung Ju Won ),( Kwan Choi ),( Mincheol Whang ) 한국감성과학회 2014 춘계학술대회 Vol.2014 No.-

The social relationship was including the interaction factor between the persons. In order to detect social relationship, it was using the unconscious response rather than conscious. The purpose of this study was to determine evaluation of social relationship using micro-movement expressed both automatic and unconscious. We used the ``vibra-image``technology based on vision as the indicator of micro-movement. The vibra-image was consisted with 10 factors such as aggression, stress, tension/anxiety, suspect, balance, charm, energy, self-regulation, inhibition, and neuroticism. 12 subjects were participated in this experiment, assigned two groups. The one group was a friend (strong social relationship), and other was a stranger (weak social relationship). Participants were required interaction of facial expression with face to face. Following the result, the stranger group was significantly increased the factor of Aggression, Suspect, Balance of vibra-image factors, and friend group was not. We found that the tension and anxiety factor could be evaluating the social relationship. Also, the proposed method was only using webcam based on micro-movement without attaching the sensor based on physiological signal.

Evaluation of social relationship between two persons using micro-movement in vestibular system

Sung Teac Hwang,Sangin Park,Myoung Ju Won,Kwan Choi,Mincheol Whang 대한인간공학회 2014 대한인간공학회 학술대회논문집 Vol.2014 No.5

The social relationship was including the interaction factor between the persons. In order to detect social relationship, it was using the unconscious response rather than conscious. The purpose of this study was to determine evaluation of social relationship using micro-movement expressed both automatic and unconscious. We used the „vibra-image‟ technology based on vision as the indicator of micro-movement. The vibra-image was consisted with 10 factors such as aggression, stress, tension/anxiety, suspect, balance, charm, energy, self-regulation, inhibition, and neuroticism. 12 subjects were participated in this experiment, assigned two groups. The one group was a friend (strong social relationship), and other was a stranger (weak social relationship). Participants were required interaction of facial expression with face to face. Following the result, the stranger group was significantly increased the factor of Aggression, Suspect, Balance of vibra-image factors, and friend group was not. We found that the tension and anxiety factor could be evaluating the social relationship. Also, the proposed method was only using webcam based on micro-movement without attaching the sensor based on physiological signal.

진동이미지 기술을 이용한 졸음 평가 유효 변수 추출

황성택(Sung Teac Hwang),박상인(Sang In Park),안상민(Sang Min Ahn),최진관(Jin Kwan Choi),황민철(Mincheol Whang) 한국HCI학회 2013 한국HCI학회 학술대회 Vol.2013 No.1

기존의 졸음 평가 방법은 운전자 센서를 착용해야하는 부담감이나 운전 환경에 따른 제약이 존재함으로 새로운 졸음 평가 방법이 필요한 실정이다. 따라서 본 연구는 진동이미지 기술을 사용하여 EEG 변수와의 상관 분석을 통해 새로운 측정 방법에 가능성을 확인하고자 한다. 본 연구는 6명의 피험자를 대상으로 졸음을 유발하여 EEG 신호와 영상 데이터를 측정하였다. 측정된 EEG 데이터는 스펙트럼 분석을 통해 알파(Alpa), 베타(Beta), 세타(Theta), 델타(Delta)의 변수를 추출하였고 영상 데이터는 진동이미지기술을 통해 미동의 진동과 주파수를 의미하는 9개의 변수를 추출하였다. 추출된 EEG와 진동이미지 데이터의 각 변수는 상관 분석을 통해 비교하였다. 분석 결과 EEG와 영상 변수 간의 높은 상관관계를 나타내는 변수가 확인 되었다. 본 연구의 상관 분석 결과를 통해 추출된 진동이미지의 유효 변수는 기존의 졸음 평가 방법의 한계점을 보완 할 수 있는 새로운 졸음 평가 방법으로 활용 할 수 있을 것으로 예상된다. Previous Drowsiness evaluation methods used driver-dependant sensor, where it burdened dirvers to wear sensors and also distracted or limited drivers to drive freely. Due to this limitation and driver-unfriendly method, new drowsiness evaluation method was required. Therefore, this research was evaluating new method by using vibration image technology with EEG parameters and correlations. Six subjects were forcefully induced with drowsiness, and EEG signals and image data of each subject was measured by using new method. Measured EEG signal was anaylsed by FFT (Fast Fourier Transform) analysis to extract Alpha, Beta, Theta, and Delta parameters. Also, measured image data was extracted by using "vibration image technology" to achieve nine parameters such as A1, and etc. Obtained parameters were compared using correlation analysis. Result of this comparison showed that there was significant relationship between measured parameters and drowsiness. Conclusively, this new method will improve and compensate the limitation of existing method of measuring drowsiness.

인체 미동을 이용한 공감도 평가 방법

황성택 ( Sung Teac Hwang ),박상인 ( Sangin Park ),원명주 ( Myoung Ju Won ),황민철 ( Mincheol Whang ) 한국감성과학회 2017 감성과학 Vol.20 No.1

본 연구는 사회 감성(Social emotion)중 공감도 정량화 방법을 제안하고자 한다. 비접촉형 센싱 방법인 인체 미동 기술을 이용하였다. 참가자들은 공감한 그룹과 공감하지 않은 그룹으로 분류하였다. 웹캠(Web-cam)을 이용해 표정Task를 수행하는 동안 영상의 상반신 데이터를 수집하였다. 수집 된 데이터는 각 주파수 성분 별로 0.5 Hz, 1 Hz, 3 Hz, 5 Hz, 15 Hz로 분류하여 추출하였다. 추출 된 데이터는 움직임의 평균과 변화량, 움직임의 동조현상을 비교하였다. 그 결과 공감한 그룹의 움직임 평균과 움직임의 변화정도가 낮게 나타났다. 공감하지 못한 그룹의 경우 평균 움직임과 변화정도가 큰 것으로 나타났으며 통계적으로 유의한 차이를 보였다. 또한 공감한 그룹의 두 피험자의 경우 표정 Task를 수행하는 동안 움직임에 동조 현상이 나타나는 것을 확인하였다. 이는 두 사람 간에 공감이 형성 되었을 때 자연스럽게 집중을 하게 되고 그에 따라 움직임에 정도가 차이가 나는 것으로 볼 수 있다. 본 연구는 비접촉 센싱방법을 통해 공감도 측정 가능성을 확인하는데 의의가 있다. The goal of this study is to present quantification method for empathy. The micro-movement technology (non-contact sensing method) was used to identify empathy level. Participants were first divided into two groups: Empathized and not empathized. Then, the upper body data of participants were collected utilizing web-cam when participants carried expression tasks. The data were analyzed and categorized into 0.5 Hz, 1 Hz, 3 Hz, 5 Hz, 15 Hz. The average movement, variation, and synchronization of the movement were then compared. The results showed a low average movement and variation in a group who empathized. Also, the participants, who empathized, synchronized their movement during the task. This indicates that the people concentrates with each other when empathy has been established and show different levels of movement. These findings suggest the possibility of empathy quantification using non-contact sensing method.

3D 시각피로 유발에 따른 안면 온도 변화

황성택 ( Sung Teac Hwang ),박상인 ( Sang In Park ),원명주 ( Myoung Ju Won ),황민철 ( Min Cheol Whang ) 한국감성과학회 2013 감성과학 Vol.16 No.4

본 연구는 3D 산업의 안전성 문제인 3차원 콘텐츠로 유발된 시각피로를 안면 온도 변화로 정량화하는 방법을 제안하고자 한다. 콘텐츠 시청 전과 후에 각 1분간 열화상 카메라를 이용하여 안면온도를 측정하였고 주관설문과 인지부하 실험을 통해 시각피로를 판단하였다. 2D와 3D의 시청 전과 후를 비교하여 3D 콘텐츠 시청에 따른 시각피로 유발 시 안면 온도에 차이를 확인하였다. 시청 전과 후에 차이를 비교한 결과 주관 설문과 인지부하 실험은 유의한 차이를 보였고 ERP latency는 3D 시청 시 증가하는 것으로 나타났다. 안면 온도의 경우 미간(forehead)과 코끝(tip of the nose) 영역의 최대값을 비교 결과 유의한 차이를 보였다. 선행 연구에서 3D 시각피로 발생 시 교감신경계가 항진됐던 결과와 비교해보면 교감신경계가 항진되면 심박 수가 증가하고 목동맥계(carotid arteries system)를 통한 안면으로의 혈류량이 증가하게 된다. 2D와 3D 시청 시 교감신경계 항진 정도에 따라서 혈류량 변화로 안면 온도에 영향을 미치는 것으로 확인되었다. 본 연구는 열화상이미지를 이용한 3D 시각피로 측정 가능성을 확인하는데 의의가 있다. As the visual fatigue induced by 3D visual stimulation has raised some safety concerns in the industry, this study aims to quantify the visual fatigue through the means of measuring the facial temperature changes. Facial temperature was measured for one minute before and after watching a visual stimulus. Whether the visual fatigue has occurred was measured through subjective evaluations and high cognitive tasks. The difference in the changes that occurred after watching a 2D stimulus and a 3D stimulus was computed in order to associate the facial temperature changes and the visual fatigue induced by watching 3D contents. The results showed significant differences in the subjective evaluations and in the high cognitive tasks. Also, the ERP latency increased after watching 3D stimuli. There were significant differences in the maximum value of the temperature at the forehead and at the tip of the nose. A previous study showed that 3D visual fatigue activates the sympathetic nervous system. Activation of the sympathetic nervous system is known to increase the heart rate as well as the blood flow into the face through the carotid arteries system. When watching 2D or 3D stimuli, the sympathetic nervous system activation dictates the blood flow, which then influences the facial temperature. This study is meaningful in that it is one of the first investigations that looks into the possibility to measure 3D visual fatigue with thermal images.

A Study on Facial Coding Differentiating Among Surprise, Anger, and Fear Facial Affects

( Hyun Jean Park ),( Sung Teac Hwang ),( Min Cheol Whang ) 한국감성과학회 2012 춘계학술대회 Vol.2012 No.-

심전도 반응 기반 경쟁, 협동 게임 참여자의 몰입 판단 알고리즘 개발

이정년(Jung-Nyun Lee),황민철(Min-Cheol Whang),박상인(Sang-In Park),황성택(Sung-Teac Hwang) 한국게임학회 2017 한국게임학회 논문지 Vol.17 No.2

최근 청소년들의 인터넷 및 스마트폰 과도한 사용이 사회적 이슈가 되어왔다. 작업에 대한 몰입 수준은 좋은 결과물을 만들 수 있는 긍정적 효과와 과 몰입 같은 부정적 효과를 모두 가지고 있다. 본 연구는 심혈관 반응 기반의 몰입 상태를 판단하는 알고리즘을 개발하고자 하였다. 피험자들은 무 자극상태, 그리고 몰입을 유발하기 위한 패턴 맞추기 게임을 수행하였고, 몰입 수준을 제공하기 위해 협력과 경쟁 태스크로 나누어 실험 디자인 하였다. 각 태스크에 따라 심박과 진폭의 상관성을 분석하고 다항식 회귀 분석을 통해 회귀식 및 정확도를 확인하였다. 결과는 게임 태스크일 때, 심박과 진폭은 양의 상관성을 보였으며 무자극일 때 음의 상관성을 보였다. 개발된 다차항 회귀식으로 게임 태스크와 무 자극을 구분하는 정확도는 평균 89%의 정확도를 보였다. 태스크간의 차이는 76.5% 정확도를 확인하였다. 본 연구는 실시간으로 몰입 수준을 정량적으로 평가하는데 사용될 수 있을 것으로 기대된다. Excessive use of the internet and smart phones have become a social issue. The level of engagement has both positive and negative effects such as good performance or indulgence phenomenon, respectively. This study was to develop an algorithm to determine the engagement state based on cardiovascular response. The participants were asked to play a pattern matching game and the experimental design was divided into cooperation and competition task to provide the level of engagement. The correlation between heart rate and amplitude was analyzed according to each task. The regression equation and accuracy were verified by polynomial regression analysis. The results showed that heart rate and amplitude were positively correlated when the task was a game, and negatively correlated when there was a reference task. The accuracy of classifying between game and reference task was 89%. The accuracy between tasks was confirmed to be 76.5%. This study is expected to be used to quantitatively evaluate the level of engagement in real time.

심전도의 가속도와 진폭을 이용한 이차원 감성 인식 기술

이동원(Dong Won Lee),박상인(Sangin Park),원명주(Myoung Ju Won),황성택(Sung Teac Hwang),황민철(Mincheol Whang) 한국HCI학회 2016 한국HCI학회 학술대회 Vol.2016 No.1