Test-takers’ Performance and Perceptions in Total-Immersive Virtual Reality Paired Speaking Tests

다국어 초록 (Multilingual Abstract)

This study investigated university students’ performance and perceptions of taking paired English speaking tests in fully immersive virtual reality. A total of 36 college students at an advanced level were recruited to participate in either face-to-face (N = 20) or fully immersive VR speaking tests (N = 16), designed to explore test-takers’ speaking abilities. The students were asked to perform two decision-making tasks and fill out a questionnaire asking about their preference for the test mode and perceived levels of presence after completing the tasks. The study revealed no statistically significant difference in the students’ speaking abilities between the two testing modes, suggesting that the VR paired speaking test format could potentially serve as an alternative to the face-to-face paired speaking test. In relation to the analysis of questionnaire items, the students demonstrated a high level of immersion in the virtual environments.
Despite their preference for the face-to-face testing mode, they reported that the VR test could potentially replace the face-to-face speaking test. The semi-structured interview data gathered from three participants further revealed that the students, however, reported some discomfort with the paired speaking test itself due to pairing up with the other person. Furthermore, this study presents the limitations of the study and suggests implications for speaking assessments and future studies.

참고문헌 (Reference)

1 신상근, "가상현실기반 영어 듣기 평가 과제 및 논증기반 타당도 모형 개발 연구" 한국중등영어교육학회 14 (14): 84-109, 2021

2 Martín-Gutiérrez, J., "Virtual technologies trends in education" 13 (13): 469-486, 2017

3 Hung, S. A., "Virtual reality is not always a cure-all: Evidences from a quasi-experiment of EFL business speaking courses" 1-17, 2023

4 Vesisenaho, M., "Virtual reality in education: Focus on the role of emotions and physiological reactivity" 12 (12): 2019

5 Bamodu, X., "Virtual reality and virtual reality system components" Atlantis Press 2013

6 Messick, S., "Validity and washback in language testing" 13 (13): 241-256, 1996

7 Nanjappan, V., "User-elicited dual-hand interactions for manipulating 3D objects in virtual reality environments" 8 (8): 1-16, 2018

8 Shin, S. K., "Theory and practice of foreign language assessment" Hankook Publishing House 2010

9 Park, J. S., "The promise of English: Linguistic capital and the neoliberal worker in the South Korean job market" 14 (14): 443-455, 2011

10 Taylor, L. S., "The paired speaking test format: Recent studies" 2001

11 Perrone, M. J., "The impact of the first certificate in English examination on the EFL classroom: A washback study" Teachers College of Columbia University 2010

12 Diemer, J., "The impact of perception and presence on emotional reactions: A review of research in virtual reality" 6 (6): 1-9, 2015

13 Shubert, T., "The experience of presence: Factor analytic insights" 10 (10): 266-281, 2001

14 현일선, "The Effects of Paired Partners’ Proficiency Levels on Test-Takers’ Speaking Test Performance" 교과교육연구소 21 (21): 156-169, 2017

15 Hughes, A., "Testing for language teachers" Cambridge University Press 2003

16 Brown, H. D., "Teaching by principles: An interactive approach to language pedagogy" Pearson Education 2007

17 Baik, Y. K., "Teaching and learning in a virtual world" Hakjisa 2010

18 He, A. W., "Talking and testing: Discourse approaches to the assessment of oral proficiency" John Benjamins 1-24, 1998

19 Alderson, J. C., "State of the art review: Language testing and assessment (part two)" 35 (35): 79-113, 2002

20 Lumley, T., "Specific-purpose language performance tests tasks and interaction" 13 (13): 105-136, 1996

21 Kormos, J., "Simulating conversations in oral-proficiency assessment: A conversation analysis of role plays and non-scripted interviews in language exams" 16 (16): 163-188, 1999

22 van Lier, L., "Reeling, writhing, drawling, stretching, and fainting in coils: Oral proficiency interviews as conversations" 23 (23): 489-508, 1989

23 Galaczi, E. D., "Peer-peer interaction in a paired speaking test: The case of the First Certificate in English" Teachers College of Columbia University 2004

24 Egyud, G., "Oral testing in pairs: A secondary school perspective" 55 (55): 70-76, 2001

25 Witmer, B. G., "Measuring presence in virtual environments: A presence questionnaire" 7 (7): 225-240, 1998

26 Cheng, M. T., "Learning through playing virtual age: Exploring the interactions among student concept learning, game performance, in-game behaviors, and the use of in-game characters" 86 (86): 18-29, 2015

27 Peterson, M., "Learning participation patterns and strategy use in Second Life: An exploratory case study" 22 (22): 273-292, 2010

28 Peterson, M., "Learner interaction management in an avatar and chat-based virtual world" 19 (19): 79-103, 2006

29 Bachman, L. F., "Language testing in practice" Oxford University Press 1996

30 Hildson, J., "Language Testing in the 1990s" Modern English Publications and the British Council 189-197, 1991

31 Galaczi, E. D., "Interactional competence across proficiency levels: How do learners manage interaction in paired speaking tests?" 35 (35): 553-574, 2014

32 Taguchi, N., "Immersive virtual reality for pragmatics task development" 56 (56): 308-335, 2021

33 Zhang, H., "Head-mounted display-based intuitive virtual reality training system for the mining industry" 27 (27): 717-722, 2017

34 윤현경, "Grammar Errors in Korean EFL Learners’ TOEIC Speaking Test" 한국영어교육학회 67 (67): 287-309, 2012

35 Jeon, M., "Globalization and native English speakers in English programme in Korea (EPIK)" 22 (22): 231-243, 2009

36 Kramsch, C., "From language proficiency to interactional competence" 70 (70): 366-372, 1986

37 Melchor-Couto, S., "Foreign language anxiety levels in Second Life oral interaction" 29 (29): 99-119, 2016

38 Levak, N., "Facilitating second language learners’ listening comprehension with Second Life and Skype" 29 (29): 200-218, 2016

39 Swain, M., "Examining dialogue: Another approach to content specification and to validating inferences drawn from test scores" 18 (18): 275-300, 2001

40 Chien, S., "Effects of peer assessment within the context of spherical video-based virtual reality on EFL students’ English-speaking performance and learning perceptions" 146 (146): 1-20, 2020

41 박한나, "Effects of Virtual Reality-based English Learning on Korean University Students’ Speaking Ability" 한국멀티미디어언어교육학회 25 (25): 93-119, 2022

42 Park, M., "Development and validation of virtual interactive tasks for an aviation English assessment" Iowa State University 2015

43 de Lucia, A., "Development and evaluation of a virtual campus on Second Life: The case of second DMI" 52 (52): 220-233, 2009

44 Walshe, N., "Developing reflective trainee teacher practice with 360-degree video" 78 (78): 97-105, 2019

45 Ho, C. M. I., "Designing and implementing virtual enactive role-play and structured argumentation: Promises and pitfalls" 22 (22): 381-408, 2009

46 Steuer, J., "Defining virtual reality: Dimensions determining telepresence" 4 (4): 73-93, 1992

47 Quian, D. D., "Comparing direct and semi-direct modes for speaking assessment: Affective effects on test takers" 6 (6): 113-125, 2009

48 Jacoby, S., "Co-construction: An introduction" 28 (28): 171-183, 2010

49 Luoma, S., "Assessing speaking" Cambridge University Press 2004

50 Ducasse, A. M., "Assessing paired orals: Rater’s orientation to interaction" 26 (26): 423-443, 2009

51 Ockey, G. J., "Assessing L2 listening: Moving towards authenticity" John Benjamins 2018

52 Richards, J. C., "Approaches and methods in language teaching" Cambridge University Press 2014

53 Song, J., "A study of ESL students’ performance and perceptions in face-to-face and virtual-world group oral tests" The University of Texas 2014

54 MacCreery, M. P., "A sense of self: The role of presence in virtual environments" 29 (29): 1635-1640, 2013

55 McFaul, H., "A realist evaluation of student use of a virtual reality smartphone application in undergraduate legal education" 51 (51): 572-589, 2019

56 Lazaraton, A., "A qualitative approach to the validation of oral language tests (Vol. 14)" Cambridge University Press 2002

57 Freina, L., "A literature review on immersive virtual reality in education: State of the art and perspectives" National Defense University 133-, 2015

58 Ghanbarzadeh, R., "A decade of research on the use of three-dimensional virtual worlds in health care: A systematic literature review" 16 (16): e47-, 2014

59 Chen, G., "A comparison of reading comprehension across paper, computer screens, and tablets: Does tablet familiarity matter?" 1 : 213-225, 2014

60 이아름, "A Study on HMD-based Virtual Reality Listening Tests and Test-takers’ Perceived Levels of Presence" 한국멀티미디어언어교육학회 25 (25): 9-30, 2022