Word Embedding 자질을 이용한 한국어 개체명 인식 및 분류

다국어 초록 (Multilingual Abstract)

Named Entity Recognition and Classification (NERC) is a task for recognition and classification of named entities such as a persons name, location, and organization. There have been various studies carried out on Korean NERC, but they have some problems, for example lacking some features as compared with English NERC. In this paper, we propose a method that uses word embedding as features for Korean NERC. We generate a word vector using a Continuous-Bag-of- Word (CBOW) model from POS-tagged corpus, and a word cluster symbol using a K-means algorithm from a word vector. We use the word vector and word cluster symbol as word embedding features in Conditional Random Fields (CRFs). From the result of the experiment, performance improved 1.17%, 0.61% and 1.19% respectively for TV domain, Sports domain and IT domain over the baseline system. Showing better performance than other NERC systems, we demonstrate the effectiveness and efficiency of the proposed method.

참고문헌 (Reference)

1 배상준, "한국어 위키피디아를 이용한 분류체계 생성과 개체명 사전 자동 구축" 한국정보과학회 16 (16): 492-496, 2010

2 J. Turian, "Word representations:A simple and general method for semisupervised learning" 384-394, 2010

3 이창기, "Structural SVMs 및 Pegasos 알고리즘을 이용한 한국어 개체명 인식" 한국인지과학회 21 (21): 655-667, 2010

4 DM. Bikel, "Nymble: a High-Performance Learning Namefinder" 194-201, 1997

5 C. Lee, "Named Entity Recognition using Deep Learning" 423-425, 2014

6 E. Chung, "Korean Name Entity Detection using Co-Training Methods" 1289-1293, 2003

7 X. Liu, "Joint Inference of Named Entity Recognition and Normalization for Tweets" 1 : 526-535, 2012

8 C. Lee, "Fine-Grained Named Entity Recognition using Conditional Random Fields for Question Answering" 268-272, 2006

9 T. Mikolov, "Efficient Estimation of Word Representations in Vector Space" 2013

10 J. Hong, "A New Korean Morphological Analyzer using Eojeol Pattern dictionary" 279-284, 2008

11 Y. Bengio, "A Neural Probabilistic Language Model" 3 : 1137-1155, 2003

12 Y. Song, "A Constructing Method of Named Entity Dictionary using Wikipedia Based on Information Retrieval Method" 648-650, 2015