Exploring the Potential of Integrating Mobile Augmented Reality (AR) Into Speaking Performance Assessment

다국어 초록 (Multilingual Abstract)

The study aims to explore the possibility of applying mobile AR technology into an English-speaking performance assessment as a new mode of delivery. It investigates the effect of the AR experience on test participants and the speaking constructs to be assessed, all of which affect the validity. The speaking assessment required 148 high school senior male students to create an AR-mediated art guide by recording a video art guide and projecting it onto a picture of Korean genre painting via the mobile AR authoring tool, “HP Reveal” (Hewlett Packard, 2018). Both quantitative methods of regression and factor analysis and qualitative methods of a questionnaire and interview were used to attain the research goal. The results offer empirical support to the validity of the newly designed assessment and reveal that integrating AR technology into language assessment could facilitate student learning in the assessment procedure and enhance student performance during the test as well as measure their speaking competence. Discussions and suggestions address the validation issue resulting from integrating technology skill with the language construct to be measured, the comparability with assessments of other modes such as listening, reading, and writing and the theoretical relevance to task-based language learning.

참고문헌 (Reference)

1 Park, I. W., "Understanding of augmented reality and virtual reality contents and ways to educational applications" Korea Education and Research Information Service 2017

2 West, M., "UNESCO policy guidelines for mobile learning" UNESCO 2013

3 Chen, W., "To click or not to click : Effectiveness of rating classroom behaviors on academic achievement with tablets" 50 (50): 440-455, 2017

4 Wang, A. I., "The wear out effect of a game-based student response system" 82 : 217-227, 2015

5 Chen, C. H., "The implementation and evaluation of a mobile self-and peerassessment system" 55 (55): 229-236, 2010

6 Chung, Y. -R., "The handbook of technology and second language teaching and learning" WILEY Blackwell 565-588, 2017

7 Gonzáles-Lloret, M., "The handbook of technology and second language teaching and learning" WILEY Blackwell 406-435, 2014

8 Sung, Y. T., "The effects of integrating mobile devices with teaching and learning on students’ learning performance : A meta-analysis and research synthesis" 94 : 252-275, 2016

9 Chew, S. W., "The effect of learning English idioms using scaffolding strategy through situated learning supported by augmented reality" 2018

10 Triantafillou, E., "The design and evaluation of a computerized adaptive test on mobile devices" 50 (50): 1319-1330, 2008

11 Chapelle, C. A., "The companion to language assessment" John Wiley & Sons 1081-1097, 2014

12 Chapelle, C. A., "Technology-mediated TBLT: Researching technology and tasks" John Benjamins 323-334, 2014

13 Ellis, R., "Task-based language learning and teaching" Oxford University Press 2003

14 Bejar, I, "TOEFL 2000 listening framework: A working paper" Educational Testing Service 2000

15 Campbell, A., "Performance, assessment and communication in one app : Mobile tablet assessment is here to stay" 7 (7): 1-3, 2014

16 Doughty, C., "Optimal psycholinguistic environments for distance foreign language learning" 7 (7): 50-80, 2003

17 Santos, P., "Modeling the computing-based testing domain extending IMS QTI : Framework, models and exemplary implementations" 28 (28): 1648-1662, 2012

18 Nikou, S. A., "Mobile-based assessment : A literature review of publications in major referred journals from 2009 to 2018" 125 : 101-119, 2018

19 Johnson, D. W., "Learning together and alone: Cooperative, competitive, and individualistic learning" Allyn and Bacon 1994

20 Hsu, T. C., "Learning English with augmented reality: Do learning styles matter?" 106 : 137-149, 2017

21 Chao, K. H., "Integration of mobile AR technology in performance assessment" 19 (19): 239-251, 2016

22 Serio, Á. D., "Impact of an Augmented Reality(AR)system on students’ motivation for a visual art course" 68 : 586-596, 2013

23 Dunleavy, M., "Handbook of research on educational communications and technology" Springer 735-745, 2014

24 Hewlett Packard, "HP Reveal [Mobile application]"

25 Battelle for Kids, "Framework for 21st century learning"

26 Song, Y., "Fostering personalized learning in science inquiry supported by mobile technologies" 60 (60): 679-701, 2012

27 Wang, Y. H., "Exploring the effectiveness of integrating augmented reality-based materials to support writing activities" 113 : 162-176, 2017

28 Chapelle, C. A., "English language learning and technology: Lectures on applied linguistics in the age of information and communication technology" John Benjamins 2003

29 Nunan, D., "Designing tasks for the communicative classroom" Cambridge University Press 1989

30 Cuendet, S., "Designing augmented reality for the classroom" 68 : 557-569, 2013

31 Chapelle, C. A., "Designing a prototype tablet-based learning-oriented assessment for middle school English learners: An evidence-centered design approach" Educational Testing Service 2018

32 Smith, B., "Computer-mediated negotiated interaction : An expanded model" 87 (87): 38-57, 2003

33 Luecht, R. M., "Computer-based testing:Building the foundations for future assessments" Lawrence Erlbaum 67-88, 2002

34 Chapelle, C. A., "Computer applications in second language acquisition:Foundations for teaching, testing, and research" Cambridge University Press 2001

35 Kenyon, D. M., "Comparing examinee attitudes toward computerassisted and other oral proficiency assessments" 5 (5): 60-83, 2001

36 Tsai, K. -H., "Collaborative networks and production innovation performance : Toward a contingency perspective" 38 (38): 765-778, 2009

37 Blagg, D., "Augmented reality technology brings learning to life"

38 Santos, M. E. C., "Augmented reality learning experiences : Survey of prototype design and evaluation" 7 (7): 38-56, 2014

39 Sommerauer, P., "Augmented Reality for teaching and learning—A literature review on theoretical and empirical foundations" 2018

40 Luoma, S., "Assessing speaking" Cambridge University Press 2004

41 Wren, D. G., "Assessing deeper learning" Rowman & Littlefield 2019

42 Lai, C. L., "An interactive peer-assessment criteria development approach to improving students’ art design performance using handheld devices" 85 : 149-159, 2015

43 Azuma, R. T., "A survey of augmented reality" 6 (6): 355-385, 1997

44 Cheung, W. S., "A review of research methodologies used in studies on mobile handheld devices in K-12 and higher education settings" 25 (25): 153-183, 2009

45 Hwang, G. J., "A formative assessment-based mobile learning approach to improving the learning attitudes and achievements of students" 56 (56): 1023-1031, 2011

46 Liu, T. Y., "A context-aware ubiquitous learning environment for language listening and speaking" 25 (25): 515-527, 2009

47 Chapelle, C. A., "20 years of technology and language assessment in Language Learning & Technology" 20 (20): 116-128, 2016