얼굴 감정을 이용한 시청자 감정 패턴 분석 및 흥미도 예측 연구 = A Study on Sentiment Pattern Analysis of Video Viewers and Predicting Interest in Video using Facial Emotion Recognition

다국어 초록 (Multilingual Abstract)

Emotion recognition is one of the most important and challenging areas of computer vision. Nowadays, many studies on emotion recognition were conducted and the performance of models is also improving. but, more research is needed on emotion recognition and sentiment analysis of video viewers. In this paper, we propose an emotion analysis system the includes a sentiment analysis model and an interest prediction model. We analyzed the emotional patterns of people watching popular and unpopular videos and predicted the level of interest using the emotion analysis system. Experimental results showed that certain emotions were strongly related to the popularity of videos and the interest prediction model had high accuracy in predicting the level of interest.

참고문헌 (Reference)

1 유창한 ; 김승범, "절정-대미 원칙을 기반으로 설계된 유튜브 동영상 콘텐츠가 시청자 반응에 미치는 영향에 관한 연구" 한국산업정보학회 26 (26): 43-56, 2021

2 원철호, "멀티스케일 LBP를 이용한 얼굴 감정 인식" 한국멀티미디어학회 17 (17): 1383-1392, 2014

3 정지원 ; 이재영 ; 임춘성, "YouTube 영상에 대한 카테고리별 특성 및 사용자 반응성 분석에 관한 연구" 한국디지털콘텐츠학회 20 (20): 2573-2581, 2019

4 K. Simonyan, "Very Deep Convolutional Networks for Large-Scale Image Recognition"

5 D. R. Cox, "The Regression Analysis of Binary Sequences" 20 (20): 215-242, 1958

6 F. Ma, "Robust Facial Expression Recognition with Convolutional Visual Transformers"

7 K. Alex, "ImageNet Classification with Deep Convolutional Neural Networks" 1 : 1097-1105, 2012

8 S. Christian, "Going Deeper with Convolutions"

9 W. Mellouk, "Facial Emotion Recognition using Deep Learning : Review and Insights" 175 : 689-694, 2020

10 N. Mehendale, "Facial Emotion Recognition using Convolutional Neural Networks(FERC)" 2 : 446-, 2020

11 P. Ekman, "Emotion in the Human Face" Pergamon Press 1972

12 K. He, "Deep Residual Learning for Image Recognition"