테크놀로지 기반 자기조절 지원의 효과에 대한 메타분석 = A meta-analysis on the effects of technology-based self-regulation support

다국어 초록 (Multilingual Abstract)

This study conducted a meta-analysis to explore the effects of technology-based self-regulation interventions in online learning and to provide insights for designing self-regulation support tools. Based on the selection criteria, 33 studies published from 2012 to September 2022 were included in the final analysis, and one of the studies conducted three experiments resulting in 35 effect sizes in total. This study calculated the effect sizes of overall technology-based self-regulation support, dependent variables, sub-factors of self-regulation, and moderating variables. The results of the study are as follows: First, the overall effect size of technology-based self-regulation support was 0.49, indicating a moderate effect size. Second, among the dependent variables, slightly small effect sizes were shown in the cognitive and self-regulation variables, while the effect size of the affective variable was statistically not significant. Third, among the moderating variables, support types and personalized intervention reached statistical significance. By support types, the effect size was larger in the order of the system, dashboard, mixed support, and prompt. Interventions providing personalized support had a larger effect size than those that did not. In conclusion, this study comprehensively analyzed the effects of technology-based self-regulation support using a meta-analysis, which provided implications for the design of self-regulation support tools.

참고문헌 (Reference)

1 나청수 ; 주현 ; 이진주 ; 김동식, "컴퓨팅 사고력 향상을 위한 국내 SW 교육에 대한 메타분석" 한국교육공학회 34 (34): 775-815, 2018

2 신문승 ; 강충열, "초등학교 창의성교육 프로그램의 효과에 관한 메타분석" 한국초등교육학회 22 (22): 113-135, 2009

3 양미진 ; 신인수 ; 방소희 ; 유준호, "청소년상담 프로그램의 효과에 대한 메타분석" 한국청소년상담복지개발원 26 (26): 291-316, 2018

4 정애경, "자기조절학습을 지원하는 모바일 연동 학습관리시스템 개발연구" 한국컴퓨터교육학회 12 (12): 23-34, 2009

5 임철일, "자기조절학습을 지원하는 기업의 이러닝 학습관리체제의 개발과 효과에 관한 연구" 한국교육공학회 21 (21): 77-100, 2005

6 강윤경 ; 장유나 ; 배상영 ; 홍세희, "인공지능 교육프로그램이 청소년에게 미치는 효과 연구에 대한 메타분석" 한국교육정보미디어학회 27 (27): 1273-1294, 2021

7 심현, "온라인 학습환경에서 멘토의 피드백이 자기조절학습능력, 자기주도학습, 학업성취에 미치는 영향" 한국열린교육학회 25 (25): 169-189, 2017

8 김성빈 ; 임규연, "온라인 고등․평생교육 학습자의 학습참여 동기와 학습 만족도 관계에서 지각된 유용성, 자기조절학습 능력의 조절효과 검증" 미래원격교육연구원 13 (13): 85-107, 2017

9 황성동, "알기 쉬운 메타분석의 이해" 학지사 2014

10 성균관대학교, "성균관대학교 iCampus"

11 이화여자대학교, "미래를 선도할 이화형 교수학습모델 ‘THE BEST’ 시범 운영"

12 대학원격교육지원센터, "대학원격교육지원센터 월간동향 vol.12"

13 대구광역시교육지원청, "대구중등학습놀이터"

14 e학습터, "e학습터 꿈을 이루는 공간"

15 Molenaar, I., "Young learners’ regulation of practice behavior in adaptive learning technologies" 10 : 2792-, 2019

16 University of Chicago, "Wherever you are, learn with the University of Chicago"

17 Lim, L. A., "What changes, and for whom? A study of the impact of learning analytics-based process feedback in a large course" 72 : 101202-, 2021

18 Chen, C. H., "Using the BookRoll e-book system to promote self-regulated learning, self-efficacy and academic achievement for university students" 22 (22): 33-46, 2019

19 Guo, L., "Using metacognitive prompts to enhance self-regulated learning and learning outcomes : A meta analysis of experimental studies in computer-based learning environments" 38 (38): 811-832, 2022

20 Sonnenberg, C., "Using Process Mining to examine the sustainability of instructional support : How stable are the effects of metacognitive prompting on self-regulatory behavior" 96 : 259-272, 2019

21 Saks, K., "The efficiency of prompts when supporting learner use of cognitive and metacognitive strategies" 32 (32): 1-16, 2019

22 Nguyen, L. T., "The effects of ePortfolio-based learning model on student self-regulated learning" 16 (16): 197-209, 2015

23 Lanqin Zheng, "The effectiveness of self-regulated learning scaffolds on academic performance in computer-based learning environments: a meta-analysis" 교육연구소 17 (17): 187-202, 2016

24 Ezin, C. C., "The effect of learning analytics-based interventions in mobile learning on students' academic achievements, self-regulated learning skills, and motivations" Universal Access in the Information Society 1-16, 2022

25 Chang, Y., "The 5min meta-analysis : understanding how to read and interpret a forest plot" 36 : 673-675, 2022

26 Broadbent, J., "Tertiary Online Teaching and Learning(Vol. 4)" Springer 299-308, 2020

27 Lee, D., "Systematic literature review on self-regulated learning in massive open online courses" 35 (35): 28-41, 2019

28 Cooper, H., "Synthesizing research: A guide for literature reviews" Sage 1998

29 Daumiller, M., "Supporting self-regulated learning with digital media using motivational regulation and metacognitive prompts" 87 (87): 161-176, 2019

30 Edisherashvili, N., "Supporting self-regulated learning in distance learning contexts at higher education level : systematic literature review" 12 : 1-21, 2022

31 Wong, J., "Supporting self-regulated learning in online learning environments and MOOCs: A systematic review" 35 (35): 356-373, 2019

32 Bannert, M., "Supporting self-regulated hypermedia learning through prompts" 40 : 193-211, 2012

33 Lin, X., "Supporting learning of variable control in a computer-based biology environment : Effects of prompting college students to reflect on their own thinking" 36 (36): 837-858, 1999

34 Jansen, R. S., "Supporting learners' self-regulated learning in Massive Open Online Courses" 146 : 1-17, 2020

35 Wang, C. H., "Students’ characteristics, self-regulated learning, technology self-efficacy, and course outcomes in online learning" 34 (34): 302-323, 2013

36 Zimmerman, B. J., "Student differences in self-regulated learning : Relating grade, sex, and giftedness to self-efficacy and strategy use" 82 (82): 51-, 1990

37 Cohen, J., "Statistical power analysis for the behavioral science" Lawrence Erldbaum Associates 1988

38 Hedges, L. V., "Statistical methods for meta-analysis" Academic Press 1985

39 Sitzmann, T., "Sometimes you need a reminder : The effects of prompting self-regulation on regulatory processes, learning, and attrition" 95 (95): 132-144, 2010

40 Bannert, M., "Short-and long-term effects of students’self-directed metacognitive prompts on navigation behavior and learning performance" 52 : 293-306, 2015

41 Schunk, D. H., "Self-regulatory processes during computer skill acquisition : Goal and self-evaluative influences" 91 (91): 251-, 1999

42 Eggers, J. H., "Self-regulation strategies in blended learning environments in higher education : A systematic review" 37 (37): 175-192, 2021

43 van Alten, D. C., "Self-regulated learning support in flipped learning videos enhances learning outcomes" 158 : 1-13, 2020

44 Alonso-Mencía, M. E., "Self-regulated learning in MOOCs : lessons learned from a literature review" 72 (72): 319-345, 2020

45 Wolters, C. A., "Self-regulated learning and the 21st century competencies" University of Houston 2010

46 Viberg, O., "Self-regulated learning and learning analytics in online learning environments: A review of empirical research" 524-533, 2020

47 Winne, P. H., "Self-regulated learning and academic achievement" Erlbaum 153-189, 2001

48 Huh, Y., "Self-regulated learning : The continuous-change conceptual framework and a vision of new paradigm, technology system, and pedagogical support" 46 (46): 191-214, 2017

49 Zimmermann, B. J., "Self-Regulated Learning and Academic Achievement: Theory, Research and Practice" 1-26, 1989

50 Zimmerman, B. J., "Self- regulation of learning and performance: Issues and educational applications" Erlbaum 3-44, 1994

51 Wood, S., "School-based mentoring for adolescents : A systematic review and meta-analysis" 22 (22): 257-269, 2012

52 Ge, X., "Scaffolding students’ problem-solving processes in an ill-structured task using question prompts and peer interactions" 51 (51): 21-38, 2003

53 황성동, "R을 이용한 메타분석" 학지사 2015

54 Davis, D., "Retrieval practice and study planning in MOOCs: Exploring classroom-based self-regulated learning strategies at scale" Springer International Publishing 57-71, 2016

55 Cooper, H., "Research synthesis and meta-analysis: A step-by-step approach(Vol. 2)" Sage publications 2015

56 Silva, L., "Regulation of learning interventions in programming education: A systematic literature review and guideline proposition" 647-653, 2021

57 Dixson, W. J., "Questions of normality, Introduction to statistical analysis" McGraw-Hill 1969

58 Sterne, J. A., "Publication and related bias in meta-analysis : power of statistical tests and prevalence in the literature" 53 (53): 1119-1129, 2000

59 Schnaubert, L., "Prompting and visualising monitoring outcomes : Guiding self-regulatory processes with confidence judgments" 49 : 251-262, 2017

60 Wirth, J., "Promoting self-regulated learning through prompts" 23 (23): 91-94, 2009

61 Koh, J. H. L., "Project-based learning and student knowledge construction during asynchronous online discussion" 13 (13): 284-291, 2010

62 Pintrich, P. R., "Motivational and self-regulated learning components of classroom academic performance" 82 (82): 33-40, 1990

63 Duffy, M. C., "Motivation matters : Interactions between achievement goals and agent scaffolding for self-regulated learning within an intelligent tutoring system" 52 : 338-348, 2015

64 Schwonke, R., "Metacognitive support promotes an effective use of instructional resources in intelligent tutoring" 23 : 136-150, 2013

65 Guo, J., "Measuring and promoting self-regulation for equity and quality of online learning : New evidence from a multi-institutional survey during COVID-19" 12 (12): 465-, 2022

66 김효진 ; 송해덕 ; 윤혜주 ; 김연경, "MOOC 환경에서 자기조절학습능력과 지각된 유용성이 학습지속의향에 미치는 영향: 학습몰입의 매개효과 및 과제기술적합성의 조절효과" 한국교육공학회 38 (38): 149-177, 2022

67 Kim, D., "Learning analytics to support self-regulated learning in asynchronous online courses : A case study at a women's university in South Korea" 127 : 233-251, 2018

68 Yilmaz, F. G. K,, "Learning analytics intervention improves students’engagement in online learning" 27 (27): 449-460, 2022

69 Ustun, A. B., "Learning analytics based feedback and recommendations in flipped classrooms: An experimental study in higher education" 1-17, 2022

70 Schumacher, C., "Investigating prompts for supporting students' self-regulation–A remaining challenge for learning analytics approaches?" 49 : 1-12, 2021

71 Borenstein, M., "Introduction to meta-analysis" John Wiley & Sons 2009

72 Lee, H. W., "Improving self-regulation, learning strategy use, and achievement with metacognitive feedback" 58 : 629-648, 2010

73 Zimmerman, B. J., "Handbook of self-regulation" Academic Press 13-39, 2000

74 Reid, A. J., "Generative learning strategy use and self-regulatory prompting in digital text" 13 (13): 49-72, 2014

75 Ziegler, N. A., "Fostering self-regulated learning through the European language portfolio : An embedded mixed methods study" 98 (98): 921-936, 2014

76 Wong, J., "Facilitating goal setting and planning to enhance online self-regulation of learning" 124 : 106913-, 2021

77 Wang, X., "Facilitating English grammar learning by a personalized mobile-assisted system with a self-regulated learning mechanism" 12 : 1-13, 2021

78 Artino Jr, A. R., "Exploring the complex relations between achievement emotions and self-regulated learning behaviors in online learning" 15 (15): 170-175, 2012

79 Wong, J., "Examining the use of prompts to facilitate self-regulated learning in Massive Open Online Courses" 115 : 106596-, 2021

80 Michailidis, N., "Examining the effect of interaction analysis on supporting students’ motivation and learning strategies in online blog-based secondary education programming courses" 30 (30): 665-676, 2019

81 Zheng, J., "Emotions in self-regulated learning : A critical literature review and meta-analysis" 14 : 1137010-, 2023

82 Wäschle, K., "Effects of visual feedback on medical students’ procrastination within web-based planning and reflection protocols" 41 : 120-136, 2014

83 Song, D., "Effects of self-regulation scaffolding on online participation and learning outcomes" 53 (53): 249-263, 2021

84 Müller, N. M., "Effects of self-regulation prompts in hypermedia learning on learning performance and self-efficacy" 58 : 1-11, 2018

85 Lim, L., "Effects of real-time analytics-based personalized scaffolds on students’ self-regulated learning" 139 : 107547-, 2023

86 김정현 ; 조일현 ; 박연정, "Effects of learning analytics dashboard: analyzing the relations among dashboard utilization, satisfaction, and learning achievement" 교육연구소 17 (17): 13-34, 2016

87 de Bruijn-Smolders, M., "Effective self-regulatory processes in higher education : Research findings and future directions. A systematic review" 41 (41): 139-158, 2016

88 Bernard, R., "Effect size calculation for meta-analysis" 2009

89 Sáiz-Manzanares, M. C., "Does the use of learning management systems with hypermedia mean improved student learning outcomes?" 10 : 1-14, 2019

90 Engelmann, K., "Do self-created metacognitive prompts promote short-and long-term effects in computer-based learning environments?" 16 (16): 1-21, 2021

91 Yoon, M., "Designing supports for promoting self-regulated learning in the flipped classroom" 33 : 398-418, 2021

92 Broadbent, J., "Comparing online and blended learner's self-regulated learning strategies and academic performance" 33 : 24-32, 2017

93 Zumbach, J., "Cognitive and metacognitive support in learning with a serious game about demographic change" 103 : 120-129, 2020

94 Higgins, J., "Cochrane Handbook for systematic reviews of interventions (version 5.1.0)" The Cochrane Collaboration 2011

95 Higgins, J., "Cochrane Handbook for Systematic Reviews of Interventions (version 6.3)"

96 Pekrun, R., "Boredom in achievement settings : Exploring control–value antecedents and performance outcomes of a neglected emotion" 102 : 531-549, 2010

97 Balloo, K., "A systematic review of interventions targeting self-regulation in higher education" University of Southern Queensland 2020

98 Lara, J. A., "A system for knowledge discovery in e-learning environments within the European Higher Education Area-Application to student data from Open University of Madrid, UDIMA" 72 : 23-36, 2014

99 Khiat, H., "A self-regulated learning management system : Enhancing performance, motivation and reflection in learning" 19 (19): 43-59, 2022

100 Cogliano, M., "A self-regulated learning analytics prediction-and-intervention design : Detecting and supporting struggling biology students" 114 (114): 1801-1816, 2022

101 Su, J. M., "A rule-based self-regulated learning assistance scheme to facilitate personalized learning with adaptive scaffoldings : A case study for learning computer software" 28 (28): 536-555, 2020

102 Panadero, E., "A review of self-regulated learning : Six models and four directions for research" 422 : 1-28, 2017

103 Duval, S., "A nonparametric ‘trim and fill’ method of accounting for publication bias in meta-analysis" 95 : 89-98, 2000

104 Xu, Z., "A meta-analysis of the efficacy of self-regulated learning interventions on academic achievement in online and blended environments in K-12 and higher education" 1-21, 2022

105 Manganello, F., "A dashboard to monitor self-regulated learning behaviours in online professional development" 19 (19): 18-34, 2021

106 Ge, X., "A conceptual framework for scaffolding III-structured problem-solving processes using question prompts and peer interactions" 52 (52): 5-22, 2004

107 Pintrich, P. R., "A conceptual framework for assessing motivation and self-regulated learning in college students" 16 (16): 385-407, 2004