Systematic Review of Predictive Learning Analytics Using Online Learning Engagement Data

다국어 초록 (Multilingual Abstract)

Learning analytics has been effectively used to predict learning performance in online learning environments. On the basis of prediction results, instructors and administrators have made efforts to improve the quality of higher education. However, there is a concern that learning analytics does not guarantee the improvement of teaching and learning activities without an in-depth understanding of educational theory and practice. This study aims to review previous studies on predictive learning analytics (PLA) using online learning engagement data in higher education so as to explore the future direction of PLA. A total of 94 papers, published from 2011 to 2020, were reviewed in regard to (a) research trends, (b) types of online learning engagement, and (c) educational implications. The research on predictive learning analytics has increased rapidly, using the data collected from online learning environments. Nevertheless, there was lack of research analyzing online learning activities across different domains, which might limit a prediction model’s generalizability. In addition, PLA frequently used behavioral, cognitive, and social engagement data to predict learning performance, but not emotional engagement data. There were also limitations in giving prescriptive implications to educational stakeholders based on PLA results, although many studies focused on the accuracy of prediction. These findings imply that interdisciplinary research is necessary not only to predict learning performance accurately but also to interpret and use PLA results for the improvement of higher education.

참고문헌 (Reference)

1 Young, M., "Why educators must differentiate knowledge from experience" 22 (22): 9-20, 2010

2 Dunleavy, J., "What did you do in school today? Exploring the concept of fostering learning" 3 : 135-158, 2009

3 George D. Kuh, "What We're Learning About Student Engagement From NSSE: Benchmarks for Effective Educational Practices" Informa UK Limited 35 (35): 24-32, 2003

4 Cristobal Romero, "Web usage mining for predicting final marks of students that use Moodle courses" Wiley 21 (21): 135-146, 2010

5 Saeed‐Ul Hassan, "Virtual learning environment to predict withdrawal by leveraging deep learning" Wiley 34 (34): 1935-1952, 2019

6 Imani Mwalumbwe, "Using Learning Analytics to Predict Students’ Performance in Moodle Learning Management System: A Case of Mbeya University of Science and Technology" Wiley 79 (79): 1-13, 2017

7 Yaqun Zhang, "Using Learning Analytics to Predict Students Performance in Moodle LMS" International Association of Online Engineering (IAOE) 15 (15): 102-, 2020

8 Owen Corrigan, "Using Educational Analytics to Improve Test Performance" 42-55, 2015

9 Michelene T. H. Chi, "Translating the ICAP Theory of Cognitive Engagement Into Practice" Wiley 42 (42): 1777-1832, 2018

10 Greller, W., "Translating learning into numbers : A generic framework for learning analytics" 15 (15): 42-57, 2012

11 Dongho Kim, "Toward evidence-based learning analytics: Using proxy variables to improve asynchronous online discussion environments" Elsevier BV 30 : 30-43, 2016

12 S. M. Muthukrishnan, "Systematic mapping review on student’s performance analysis using big data predictive model" African Journals Online (AJOL) 9 (9): 730-, 2018

13 Martín Liz-Domínguez, "Systematic Literature Review of Predictive Analysis Tools in Higher Education" MDPI AG 9 (9): 5569-, 2019

14 Tal Soffer, "Students' engagement characteristics predict success and completion of online courses" Wiley 35 (35): 378-389, 2019

15 Lesley Gourlay, "Student Engagement, ‘Learnification’ and the Sociomaterial: Critical Perspectives on Higher Education Policy" Springer Science and Business Media LLC 30 (30): 23-34, 2017

16 Katrina A. Meyer, "Student Engagement in Online Learning: What Works and Why" Wiley 40 (40): 1-114, 2014

17 What Works Clearinghouse, "Standards handbook (Version 4.0)"

18 Connell, J., "Self Process in Development: Minnesota Symposium on Child Psychology" Lawrence Erlbaum 167-216, 1991

19 Jennifer A Fredricks, "School Engagement: Potential of the Concept, State of the Evidence" American Educational Research Association (AERA) 74 (74): 59-109, 2004

20 Rebeca Cerezo, "Procrastinating Behavior in Computer-Based Learning Environments to Predict Performance: A Case Study in Moodle" Frontiers Media SA 8 : 2017

21 Widyahastuti, F., "Prediction model students’ performance in online discussion forum" 6-10, 2017

22 Hajra Waheed, "Predicting academic performance of students from VLE big data using deep learning models" Elsevier BV 104 : 106189-, 2020

23 Hellas, A., "Predicting academic performance : A systematic literature review" 175-199, 2018

24 Ahmed Al-Azawei, "Predicting Learners' Performance in Virtual Learning Environment (VLE) based on Demographic, Behavioral and Engagement Antecedents" International Association of Online Engineering (IAOE) 15 (15): 60-, 2020

25 Palmer, S., "Modelling engineering student academic performance using academic analytics" 29 (29): 132-138, 2013

26 Di Mitri, D., "Learning pulse : A machine learning approach for predicting performance in self-regulated learning using multimodal data" 188-197, 2017

27 Anna Wilson, "Learning analytics: challenges and limitations" Informa UK Limited 22 (22): 991-1007, 2017

28 Dongho Kim, "Learning analytics to support self-regulated learning in asynchronous online courses: A case study at a women's university in South Korea" Elsevier BV 127 : 233-251, 2018

29 Carlos J. Villagrá-Arnedo, "Improving the expressiveness of black-box models for predicting student performance" Elsevier BV 72 : 621-631, 2017

30 Parsons, J., "Improving student engagement" 14 (14): 2011

31 Na, K. S., "Identifying at-risk students in online learning by analysing learning behaviour : A systematic review" 118-123, 2017

32 Mohammed Saqr, "How the study of online collaborative learning can guide teachers and predict students’ performance in a medical course" Springer Science and Business Media LLC 18 (18): 2018

33 Siemens, G., "Guest editorial-learning and knowledge analytics" 15 (15): 1-2, 2012

34 Ella R. Kahu, "Framing student engagement in higher education" Informa UK Limited 38 (38): 758-773, 2013

35 Carolyn P. Rosé, "Explanatory learner models: Why machine learning (alone) is not the answer" Wiley 50 (50): 2943-2958, 2019

36 C. Romero, "Educational data mining: A survey from 1995 to 2005" Elsevier BV 33 (33): 135-146, 2007

37 Cristobal Romero, "Educational data mining and learning analytics: An updated survey" Wiley 10 (10): 2020

38 Luckin, R., "Designing educational technologies in the age of AI : A learning sciences driven approach" 50 (50): 2824-2838, 2019

39 Joshua M. Rosenberg, "Context and Technological Pedagogical Content Knowledge (TPACK): A Systematic Review" Informa UK Limited 47 (47): 186-210, 2015

40 Abelardo Pardo, "Combining University Student Self-Regulated Learning Indicators and Engagement with Online Learning Events to Predict Academic Performance" Institute of Electrical and Electronics Engineers (IEEE) 10 (10): 82-92, 2017

41 Augusto Sandoval, "Centralized student performance prediction in large courses based on low-cost variables in an institutional context" Elsevier BV 37 : 76-89, 2018

42 Kshitij Sharma, "Building pipelines for educational data using AI and multimodal analytics: A “grey‐box” approach" Wiley 50 (50): 3004-3031, 2019

43 Ben Daniel, "Big Data and analytics in higher education: Opportunities and challenges" Wiley 46 (46): 904-920, 2014

44 Benazir Quadir, "Analyzing the educational goals, problems and techniques used in educational big data research from 2010 to 2018" Informa UK Limited 30 (30): 1539-1555, 2020

45 Baker, R. S., "Analyzing early at-risk factors in higher education e-learning courses" 1-6, 2015

46 조일현 ; 박연정 ; 김정현 ; 송종우, "Analysis of Online Behavior and Prediction of Learning Performance in Blended Learning Environments" 한국교육공학회 15 (15): 71-88, 2014

47 Gray, G., "An application of classification models to predict learner progression in tertiary education" 549-554, 2014

48 Petrea Redmond, "An Online Engagement Framework for Higher Education" The Online Learning Consortium 22 (22): 2018

49 Nespereira, C. G., "Am I failing this course? Risk prediction using e-learning data" 271-276, 2015

50 Jaclyn Broadbent, "Academic success is about self-efficacy rather than frequency of use of the learning management system" Australasian Society for Computers in Learning in Tertiary Education 2016

51 Xu Du, "A systematic meta-Review and analysis of learning analytics research" Informa UK Limited 40 (40): 49-62, 2019

52 Khasanah, A. U., "A review of student’s performance prediction using educational data mining techniques" 13 : 5302-5307, 2018

53 Andreas F. Gkontzis, "A predictive analytics framework as a countermeasure for attrition of students" Informa UK Limited 30 (30): 1028-1043, 2019

54 Amirah Mohamed Shahiri, "A Review on Predicting Student's Performance Using Data Mining Techniques" Elsevier BV 72 : 414-422, 2015