이진 분류문제에서의 딥러닝 알고리즘의 활용 가능성 평가

다국어 초록 (Multilingual Abstract)

Recently, AlphaGo which is Bakuk (Go) artificial intelligence program by Google DeepMind, had a huge victory against Lee Sedol. Many people thought that machines would not be able to win a man in Go games because the number of paths to make a one move is more than the number of atoms in the universe unlike chess, but the result was the opposite to what people predicted. After the match, artificial intelligence technology was focused as a core technology of the fourth industrial revolution and attracted attentions from various application domains. Especially, deep learning technique have been attracted as a core artificial intelligence technology used in the AlphaGo algorithm.
The deep learning technique is already being applied to many problems. Especially, it shows good performance in image recognition field. In addition, it shows good performance in high dimensional data area such as voice, image and natural language, which was difficult to get good performance using existing machine learning techniques. However, in contrast, it is difficult to find deep leaning researches on traditional business data and structured data analysis. In this study, we tried to find out whether the deep learning techniques have been studied so far can be used not only for the recognition of high dimensional data but also for the binary classification problem of traditional business data analysis such as customer churn analysis, marketing response prediction, and default prediction. And we compare the performance of the deep learning techniques with that of traditional artificial neural network models.
The experimental data in the paper is the telemarketing response data of a bank in Portugal. It has input variables such as age, occupation, loan status, and the number of previous telemarketing and has a binary target variable that records whether the customer intends to open an account or not. In this study, to evaluate the possibility of utilization of deep learning algorithms and techniques in binary classification problem, we compared the performance of various models using CNN, LSTM algorithm and dropout, which are widely used algorithms and techniques in deep learning, with that of MLP models which is a traditional artificial neural network model. However, since all the network design alternatives can not be tested due to the nature of the artificial neural network, the experiment was conducted based on restricted settings on the number of hidden layers, the number of neurons in the hidden layer, the number of output data (filters), and the application conditions of the dropout technique. The F1 Score was used to evaluate the performance of models to show how well the models work to classify the interesting class instead of the overall accuracy.
The detail methods for applying each deep learning technique in the experiment is as follows. The CNN algorithm is a method that reads adjacent values from a specific value and recognizes the features, but it does not matter how close the distance of each business data field is because each field is usually independent. In this experiment, we set the filter size of the CNN algorithm as the number of fields to learn the whole characteristics of the data at once, and added a hidden layer to make decision based on the additional features. For the model having two LSTM layers, the input direction of the second layer is put in reversed position with first layer in order to reduce the influence from the position of each field. In the case of the dropout technique, we set the neurons to disappear with a probability of 0.5 for each hidden layer.
The experimental results show that the predicted model with the highest F1 score was the CNN model using the dropout technique, and the next best model was the MLP model with two hidden layers using the dropout technique. In this study, we were able to get some findings as the experiment had proceeded. First, models using dropout techniques have a

참고문헌 (Reference)

1 안성만, "딥러닝의 모형과 응용사례" 한국지능정보시스템학회 22 (22): 127-142, 2016

2 Graves, A., "Speech recognition with deep recurrent neural networks" 6645-6649, 2013

3 Kim, K. T., "Perchase prediction through clickstream data of internet store based on deep learning technique" Graduate School, Hanyang University 2016

4 Cho, K., "On the properties of neural machine translation: Encoder-decoder approaches"

5 Fukushima, K., "Neocongnitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position" 36 (36): 193-202, 1980

6 Hochreiter, S., "Long short-term memory" 9 (9): 1735-1780, 1997

7 Choi, H. Y., "Introduction to deep learning and major issues" 22 (22): 1-15, 2015

8 Kim, U. J., "Introduction to artificial intelligence, machine learning, and deep learning with algorithms" wikibook 2016

9 Krizhevsky, A., "Imagenet classification with deep convolution neural networks" 25 : 1097-1105, 2013

10 Srivastava, N., "Dropout: a simple way to prevent neural networks from overfitting" 15 (15): 1929-1958, 2014

11 Kim, J. W., "Deep learning algorithms and applications" 33 (33): 25-31, 2015

12 LeCun, Y., "Deep learning" 521 (521): 436-444, 2015

13 Zhang, B. T., "Deep hypernetwork models" 33 (33): 11-24, 2015

14 김호준, "CNN 모델과 FMM 신경망을 이용한 동적 수신호 인식 기법" 한국지능정보시스템학회 16 (16): 95-108, 2010

15 조남옥, "Bankruptcy Type Prediction Using A Hybrid Artificial Neural Networks Model" 한국지능정보시스템학회 21 (21): 79-99, 2015

16 LeCun, Y., "Backpropagation applied to handwritten zip code recognition" 1 (1): 541-551, 1989

17 Matsuo, Y., "Artificial intelligence and deep learning" Donga M&B 2015

18 Chu, H. S., "AlphaGo’s artificial intelligence algorithm analysis" Software Policy &Research Institute 2016

19 Hinton, G. E., "A fast learning algorithm for deep belief nets" 18 (18): 1527-1554, 2006