TF-IDF의 변형을 이용한 전자뉴스에서의 키워드 추출 기법

다국어 초록 (Multilingual Abstract)

Keyword extraction is an important and essential technique for text mining applications such as information retrieval, text categorization, summarization and topic detection. A set of keywords extracted from a large-scale electronic document data are used for significant features for text mining algorithms and they contribute to improve the performance of document browsing, topic detection, and automated text classification. This paper presents a keyword extraction technique that can be used to detect topics for each news domain from a large document collection of internet news portal sites. Basically, we have used six variants of traditional TF-IDF weighting model. On top of the TF-IDF model, we propose a word filtering technique called ‘cross-domain comparison filtering’. To prove effectiveness of our method, we have analyzed usefulness of keywords extracted from Korean news articles and have presented changes of the keywords over time of each news domain.

참고문헌 (Reference)

1 강승식, "한국어 형태소 분석과 정보 검색" 홍릉과학출판사 507-549, 2002

2 Robertson, S., "Understanding inverse document frequency：on theoretical arguments for IDF" 60 (60): 503-520, 2004

3 Robertson, S. E., "The probability ranking principle in information retrieval" 33 : 294-304, 1977

4 Robertson, S. E., "Term specificity" 28 : 164-165, 1972

5 Robertson, S. E., "Specificity and weighted retrieval" 30 (30): 41-46, 1974

6 Jo, Taeho, "Keyword extraction from documents using a neural network model" 194-197, 2006

7 Matsuo, Y., "Keyword extraction from a single document using word co-occurrence statistical information" 13 (13): 157-169, 2003

8 Wang, J., "Keyword extraction based on PageRank" 4426 : 857-864, 2007

9 Yu, J. X., "Keyword Extraction using Support Vector Machine" 4016 : 85-96, 2006

10 한국인터넷진흥원, "2007년 하반기 정보화실태조사 요약 보고서" 한국인터넷진흥원 2008