트윗 데이터를 활용한 IT 트렌드 분석

다국어 초록 (Multilingual Abstract)

Predicting IT trends has been a long and important subject for information systems research. IT trend prediction makes it possible to acknowledge emerging eras of innovation and allocate budgets to prepare against rapidly changing technological trends. Towards the end of each year, various domestic and global organizations predict and announce IT trends for the following year. For example, Gartner Predicts 10 top IT trend during the next year, and these predictions affect IT and industry leaders and organization’s basic assumptions about technology and the future of IT, but the accuracy of these reports are difficult to verify. Social media data can be useful tool to verify the accuracy. As social media services have gained in popularity, it is used in a variety of ways, from posting about personal daily life to keeping up to date with news and trends. In the recent years, rates of social media activity in Korea have reached unprecedented levels. Hundreds of millions of users now participate in online social networks and communicate with colleague and friends their opinions and thoughts. In particular, Twitter is currently the major micro blog service, it has an important function named ‘tweets’ which is to report their current thoughts and actions, comments on news and engage in discussions. For an analysis on IT trends, we chose Tweet data because not only it produces massive unstructured textual data in real time but also it serves as an influential channel for opinion leading on technology. Previous studies found that the tweet data provides useful information and detects the trend of society effectively, these studies also identifies that Twitter can track the issue faster than the other media, newspapers. Therefore, this study investigates how frequently the predicted IT trends for the following year announced by public organizations are mentioned on social network services like Twitter. IT trend predictions for 2013, announced near the end of 2012 from two domestic organizations, the National IT Industry Promotion Agency (NIPA) and the National Information Society Agency (NIA), were used as a basis for this research. The present study analyzes the Twitter data generated from Seoul (Korea) compared with the predictions of the two organizations to analyze the differences. Thus, Twitter data analysis requires various natural language processing techniques, including the removal of stop words, and noun extraction for processing various unrefined forms of unstructured data. To overcome these challenges, we used SAS IRS (Information Retrieval Studio) developed by SAS to capture the trend in real-time processing big stream datasets of Twitter. The system offers a framework for crawling, normalizing, analyzing, indexing and searching tweet data. As a result, we have crawled the entire Twitter sphere in Seoul area and obtained 21,589 tweets in 2013 to review how frequently the IT trend topics announced by the two organizations were mentioned by the people in Seoul. The results shows that most IT trend predicted by NIPA and NIA were all frequently mentioned in Twitter except some topics such as ‘new types of security threat’, ‘green IT’, ‘next generation semiconductor’ since these topics non generalized compound words so they can be mentioned in Twitter with other words. To answer whether the IT trend tweets from Korea is related to the following year’s IT trends in real world, we compared Twitter’s trending topics with those in Nara Market, Korea’s online e-Procurement system which is a nationwide web-based procurement system, dealing with whole procurement process of all public organizations in Korea. The correlation analysis show that Tweet frequencies on IT trending topics predicted by NIPA and NIA are significantly correlated with frequencies on IT topics mentioned in project announcements by Nara market in 2012 and 2013. The main contribution of our research can be found in the following aspects: i) the IT topic predictions

참고문헌 (Reference)

1 문진영, "트위터에서 추출한 감기 증상의 사회적 신호와 영향요인과의 상관분석" 한국멀티미디어학회 16 (16): 667-677, 2013

2 배정환, "토픽 모델링을 이용한 트위터 이슈 트래킹 시스템" 한국지능정보시스템학회 20 (20): 109-122, 2014

3 배정환, "텍스트 마이닝을 이용한2012년 한국대선 관련 트위터 분석" 한국지능정보시스템학회 19 (19): 141-156, 2013

4 고재창, "키워드 네트워크 분석을 통해 살펴본 기술경영의 최근 연구동향" 한국지능정보시스템학회 19 (19): 101-123, 2013

5 이경호, "신문기사로부터 추출한 최근동향에 대한 트위터 감성분석" 한국정보처리학회 2 (2): 731-738, 2013

6 Klein, B. D., "User Perceptions of Data Quality:Internet and Traditional Text Sources" 41 (41): 9-14, 2001

7 Beyer, M., "The Importance of Big Data: A Definition"

8 Kostoff, R. N, "Strategic Management and Implementation of Textual Data Mining in Goverment Organization" 11 (11): 493-525, 1999

9 Kostoff, R. N, "Science and Technology Innovation" 19 (19): 593-604, 1999

10 Song. M., "Reading Others’ Mind Through Text Mining" 20 (20): 8-9, 2014

11 Madnick, S. E, "Overview and Framework for Data and Information Quality Research" 1 (1): 1-22, 2009

12 Jung, J. H., "Methodology For Future Prediction" 17 (17): 118-125, 2006

13 Luftman, J., "Key Issues for IT Executives 2012: Doing More with Less" 11 (11): 207-218, 2012

14 Caudle, S. L., "Key Information Systems Management Issues for the Public Sector" 15 (15): 171-188, 1991

15 Niederman, F., "Information Systems Management Issues for the 1990s" 15 (15): 475-500, 1991

16 Yoon, M. Y., "Global Case Studies on Big Data, ICT Issue Weekly" National Information Society Agency

17 Gantz, J., "Extracting Value from Chaos, IDC IVIEW"

18 주효진, "Effects of Motives for Social Media Use on Corporate Image : Twitter Account of Korail" 한국지방정부학회 16 (16): 51-67, 2012

19 Manyika, J., "Big data: The next frontier for innovation, competition, and productivity"

20 Cha, J. P., "Big Data Mining For United State Presidential Election" 12 : 1-28, 2012

21 Wang, R. Y, "Beyond accuracy: What data quality means to data consumers" 12 (12): 5-33, 1996

22 하기목, "A Network Analysis of Information Exchange using Social Media in ICT Exhibition" 한국지능정보시스템학회 20 (20): 1-17, 2014