스마트 홈 사용자를 위한 라이다, 영상, 오디오 센서를 이용한 인공지능 이상징후 탐지 알고리즘 = Intelligent Abnormal Situation Event Detections for Smart Home Users Using Lidar, Vision, and Audio Sensors

다국어 초록 (Multilingual Abstract)

Recently, COVID-19 has spread and time to stay at home has been increasing in accordance with quarantine guidelines of the government such as recommendations to refrain from going out. As a result, the number of single-person households staying at home is also increasingsingle-person households are less likely to be notified to the outside world in times of emergency than multi-person households. This study collects various situations occurring in the home with lidar, image, and voice sensors and analyzes the data according to the sensors through their respective algorithms. Using this method, we analyzed abnormal patterns such as emergency situations and conducted research to detect abnormal signs in humans. Artificial intelligence algorithms that detect abnormalities in people by each sensor were studied and the accuracy of anomaly detection was measured according to the sensor. Furthermore, this work proposes a fusion method that complements the pros and cons between sensors by experimenting with the detectability of sensors for various situations.

참고문헌 (Reference)

1 정주호, "이상 징후 탐지를 위한 영상, 소리, 활동 패턴 기반 지능형 패턴 인식 알고리즘" 한국컴퓨터정보학회 24 (24): 59-66, 2019

2 Joseph Redmon, "You Only Look Once: Unified, Real-Time Object Detection"

3 R. Bardeli, "Uninformed Abnormal Event Detection on Audio" 1-4, 2012

4 Serhan Cosar, "Toward Abnormal Trajectory and Event Detection in Video Surveillance" Institute of Electrical and Electronics Engineers (IEEE) 27 (27): 683-695, 2017

5 Korea Mutual-aid News, "The soaring rise of elderly lonely deaths, Urgent need for a social safety net"

6 He, Kaiming, "Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition, Lecture Notes in Computer Science"

7 Dan Jia, "Self-Supervised Person Detection in 2D Range Data using a Calibrated Camera"

8 Ross Girshick, "Rich feature hierarchies for accurate object detection and semantic segmentation"

9 Tslil, Or, "Representing and updating objects' identities in semantic SLAM" 1-7, 2020

10 Huy Phan, "Improved Audio Scene Classification Based on Label-Tree Embeddings and Convolutional Neural Networks" Institute of Electrical and Electronics Engineers (IEEE) 25 (25): 1278-1290, 2017

11 The Science Times, "How has your lifestyle changed since COVID-19?"

12 Ross Girshick, "Fast R-CNN" 2015

13 C. Premebida, "Exploiting LIDAR-based features on pedestrian detection in urban scenarios" 1-6, 2009

14 Z. Ma, "Device-Free, Activity During Daily Life, Recognition Using a Low-Cost Lidar" 1-6, 2018

15 M. Przybyła, "Detection and tracking of 2D geometric obstacles from LRF data" 135-141, 2017

16 L. Vuegen, "An MFCC GMM approach for event detection and classification" 2013

17 Xilin Yu, "An Investigation into Audio Features and DTW Algorithms for Infant Cry Classification" 54 (54): 54-59, 2019

18 Yonhapnews, "AI speaker saved for the elderly living alone"

19 Csaba Benedek, "3D people surveillance on range data sequences of a rotating Lidar" Elsevier BV 50 : 149-158, 2014

20 The Statistics Korea, "2020 Statistics show single-person households"