The Effects of Chatbot on Grammar Competence for Korean EFL College Students

다국어 초록 (Multilingual Abstract)

The purpose of this study was to test whether or not the AI chatbot is effective in acquiring target grammar for Korean EFL college students: prepositions and articles. A quasi-experiment was conducted with 46 first-year students taking part in a required English course. They were randomly divided into two groups: the experimental and control groups (23 students for each, respectively). The experimental group was engaged in six chat sessions with a chatbot over 6 weeks. A pretest and a posttest were used to examine the effectiveness of the chatbot by comparing any changes made in error frequencies of the target grammar in participants' English compositions. The results show that after a conversation with the chatbot, the experimental group significantly reduced the mean of omission errors in both prepositions and articles. To have a great effect in other error categories, chatbot feedback needs to be improved to reduce short responses or inaccurate utterances of students and induce them to actively participate in the conversation.

참고문헌 (Reference)

1 양혜진 ; 김혜영 ; 신동광 ; 이장호, "인공지능 음성챗봇기반 초등학교 영어 말하기 수업 연구" 한국멀티미디어언어교육학회 22 (22): 184-205, 2019

2 신동광, "영어 쓰기 능력 향상을 위한 AI 챗봇 활용 방안 탐색" 교육연구원 35 (35): 41-55, 2019

3 E. Ruane, "Training a Chatbot with Microsoft LUIS: Effect of Intent Imbalance on Prediction Accuracy" 63-64, 2020

4 Y. Zhao, "Technology-mediated Learning Environments for Young English Learners" Lawrence Erlbaum Associates 167-205, 2008

5 L. K. Fryer, "Stimulating and Sustaining Interest in a Language Course : An Experimental Comparison of Chatbot and Human Task Partners" 75 : 461-468, 2017

6 Y. Xu, "Same Benefits, Different Communication Patterns: Comparing Children’s Reading with a Conversational Agent vs. a Human Partner" 161 : 104059-, 2021

7 J. Hill, "Real Conversations with Artificial Intelligence : A Comparison Between Human–Human Online Conversations and Human–Chatbot Conversations" 49 (49): 240-250, 2015

8 O. W. Kwon, "Proceedings of the EUROCALL" Research-publishing 330-335, 2015

9 S. Corder, "Introducing Applied Linguistics" Penguin 1973

10 N. Haristiani, "Gengobot : A Chatbot-Based Grammar Application on Mobile Instant Messaging as Language Learning Medium" 14 (14): 3158-3173, 2019

11 A. A. Khansir, "Error Analysis and Second Language Acquisition" 2 (2): 1027-1032, 2012

12 A. Shevat, "Designing Bots: Creating Conversational Experiences" O'Reilly Media, Inc 2017

13 A. Kerly, "Bring Chatbots into Education : Towards Natural Language Negotiation of Open Learner Models" 20 : 177-185, 2006

14 L. Fryer, "Bots as Language Learning Tools. Language Learning and Technology" 10 (10): 8-14, 2006

15 C. Leacock, "Automated Grammatical Error Detection for Language Learners" Morgan & Claypool publishers 2014

16 T. Nghi, "Applying AI Chatbot for Teaching a Foreign Language: An Empirical Research" 8 (8): 897-902, 2019

17 김나영, "A Study on the Use of Artificial Intelligence Chatbots for Improving English Grammar Skills" 한국디지털정책학회 17 (17): 37-46, 2019