A Study on the Use of Artificial Intelligence Chatbots for Improving English Grammar Skills

다국어 초록 (Multilingual Abstract)

The purpose of this study is to explore the effects of the use of artificial intelligence chatbots on improving Korean college students' English grammar skills. 70 undergraduate students participated in the present study. They were taking a General English class offered by a university in Korea. There were two groups in this study. Participants in the chatbot group consisted of 36 students while those in the human group were 34. Over 16 weeks, the chatbot group engaged in ten chat sessions with a chatbot while the human group had a chat with a human chat partner. Both pre- and post-tests were performed to examine changes in the participants' grammar skills over time. To compare the improvement between the two groups, an independent t-test was then run. Main findings are as follows: First, participants in both groups significantly improved their English grammar skills, indicating the beneficial effects of engaging in chat. Also, there was a statistically significant difference in the improvement between the chatbot and human groups, indicating the superior effects of the chatbot use. This study confirmed the improved grammar skills by the participants in the chatbot group, comparison with those in the human group. Based on these findings, suggestions for the future chatbot study are discussed.

참고문헌 (Reference)

1 P. Chandrayan, "Understanding AI chatbots, challenges, opportunities, and beyond. Toward Data Science"

2 L. Williams, "The next generation: Social networking and online collaboration in foreign language learning" CALICO 145-172, 2009

3 Inn-Chull Choi, "The impact of EFL testing on EFL education in Korea" SAGE Publications 25 (25): 39-62, 2008

4 한종임, "The Effects of Post-Task CMC Activities and Task Types on Korean EFL Learners’ Oral Performance" 영상영어교육학회 17 (17): 107-133, 2016

5 D. Gonzalez, "Teaching and learning through chat: A taxonomy of educational chat for EFL/ESL" 3 (3): 57-69, 2003

6 Jianqiu Tian, "Taking language learning outside the classroom: Learners' perspectives of eTandem learning via Skype" Informa UK Limited 4 (4): 181-197, 2010

7 Sungjin Lee, "On the effectiveness of Robot-Assisted Language Learning" Cambridge University Press (CUP) 23 (23): 25-58, 2011

8 E. M. Brooks, "Incorporating pop culture in formal and informal learning environments for L2students" 7 : 29-37, 2018

9 Yu-Chih Sun, "I help, therefore, I learn: service learning on Web 2.0 in an EFL speaking class" Informa UK Limited 28 (28): 202-219, 2013

10 R. McGrath, "How to increase conversions by personalizing your chatbot"

11 B. A. Shawar, "Fostering language learner autonomy via adaptive conversation tutors" 2007

12 Minoo Alemi, "Employing Humanoid Robots for Teaching English Language in Iranian Junior High-Schools" World Scientific Pub Co Pte Lt 11 (11): 1-25, 2014

13 N. Y. Kim, "Effects of different voice-chat conditions on Korean EFL learners’ speaking ability, oral interaction, and affective factors" Ewha Womans University 2016

14 김나영, "Effects of Voice Chat on EFL Learners’ Speaking Ability according to Proficiency Levels" 한국멀티미디어언어교육학회 19 (19): 63-88, 2016

15 강동호, "EFL Learner and Teacher Beliefs about Grammar Learning in Korea" 한국영어교육학회 72 (72): 51-69, 2017

16 Yuping Wang, "Distance Language Learning: Interactivity and Fourth-generation Internet-based Videoconferencing" Equinox Publishing 21 (21): 373-395, 2013

17 Jiyou Jia, "CSIEC: A computer assisted English learning chatbot based on textual knowledge and reasoning" Elsevier BV 22 (22): 249-255, 2009

18 L. Fryer, "Bots as language learning tools. Language" 10 (10): 8-14, 2006

19 J. Hsu, "App roundup: Four AI chatbots, from good to possibly evil"

20 Y. S. Kim, "A survey study of US EFL teachers in Korea" 173-185, 2001

21 김나영, "A Study on Different Types of Speech Acts in Voice-Chat between EFL Students and a Chatbot" 글로벌영어교육학회 22 (22): 81-109, 2017

22 김나영, "A Study on Chatbots for Developing Korean College Students' English Listening and Reading Skills" 한국디지털정책학회 16 (16): 19-26, 2018

23 최인철, "A Comparability Study of Two Standardized English as a Foreign Language Tests" 언어교육원 54 (54): 277-329, 2018