이러닝 학습환경에서 학습분석기반 대시보드 연구동향 분석 = An Analytic Review of the studies on Learning Analytics based Dashboard in e-Learning Environments

다국어 초록 (Multilingual Abstract)

Learning Analytics (LA) has been recently paid attention due to the increase of e-learning. LA aims to use prescriptively the results which learner’s behaviors are analyzed and can be utilized in various ways according to users, objectives, or data source. The purpose of this study is to synthetically review the studies on LA based dashboard in e-Learning environments and to suggest directions of future research on LA based dashboard. To achieve this purpose, the review study methodology was adopted: setting up inclusion criteria, literature search and selection, setting up coding scheme, verification of literature selection and coding scheme, and analysis. 27 studies were selected and three experts with Ph.D in Educational Technology participated to the expert review survey. The research selection and coding scheme was verified(r=0.92). The analysis results were suggested according to coding scheme. Related to the purpose of dashboard development, 18 studies (67%) were for supporting learning, 16 studies (59%) were for supporting teaching, and 2 studies (7%) were for supporting decision-making related education policy. Data source which was used for developing dashboard was categorized into artifacts produced by learners, social interaction, exam/assignment results, resource use, and etc. The visualization techniques used in the previous studies were comparison, relationship, changes over time, distribution, text analysis, space, metaphor. 16 studies (59%) did not evaluate the effects of the developed dashboard, only 7 studies(26%) evaluated the effects of dashboard, and 2 studies evaluated the efficiency of dashboard. Future research directions are suggested based on the review results.

참고문헌 (Reference)

1 하건희, "학습자 성찰 도구로써 대시보드 개발을 위한 사용성 검사 연구" 이화여자대학교 2015

2 Kang Jeeae Stephanie, "학습분석학적 관점에서 개발한 시각화 대시보드가 학업성취도에 미치는 영향에 대한 탐색적 연구" 이화여자대학교 대학원 2014

3 박연정, "학습관리시스템의 대시보드 설계를 위한 학습자 중심 요구분석: 분석과 설계 도구로서 활동이론의 적용" 한국교육공학회 30 (30): 221-258, 2014

4 박연정, "학습 분석학 기반 대시보드의 설계와 적용" 한국교육정보미디어학회 20 (20): 191-216, 2014

5 김재휘, "설득 심리 이론" 커뮤니케이션북스 2013

6 한국정보통신기술협회, "빅데이터 시각화 기술"

7 Dyckhoff, A. L., "eLAT: An Exploratory Learning Analytics Tool for Reflection and Iterative Improvement of Technology Enhanced Learning" 355-356, 2011

8 Gutwin, C., "Workspace Awareness in Real-Time Distributed Groupware" University of Calgary 1997

9 Pearrow, M., "Web Site Usability Handbook with Cdrom" Charles River Media, Inc 2000

10 Mazza, R., "Visualising student tracking data to support instructors in web-based distance education" ACM 154-161, 2004

11 Merceron, A., "Visual exploration of interactions and performance with lemo" 396-397, 2013

12 Jovanović, J., "Using semantic web technologies to analyze learning content" 11 (11): 45-53, 2007

13 Mazza, R., "Using information visualisation to facilitate instructors in web-based distance learning" University of Lugano 2004

14 Gross, T., "User-centered awareness in computer-supported cooperative work-systems : Structured embedding of findings from social sciences" 18 (18): 323-360, 2005

15 Karoulis, A., "Usability evaluation of online learning programs" 88-109, 2003

16 Holzinger, A., "Usability engineering methods for software developers" 48 (48): 71-74, 2005

17 Govaerts, S., "The student activity meter for awareness and self-reflection" ACM 869-884, 2012

18 Elkina, M., "The learning analytics application LeMo–rationals and first results" 12 (12): 226-234, 2013

19 Donath, J., "The chat circles series: explorations in designing abstract graphical communication interfaces" ACM 359-369, 2002

20 Johnson, L., "The 2011 Horizon report" The New Media Consortium

21 Podgorelec, V., "Taking advantage of education data : Advanced data analysis and reporting in virtual learning environments" 114 (114): 111-116, 2011

22 Murray, T., "Supporting Deeper Deliberative Dialogue Through Awareness Tools" 2014

23 Gutwin, C., "Support for group awareness in real-time desktop conferences" 18-21, 1995

24 Essa, A., "Student success system: Risk analytics and data visualization using ensembles of predictive models" ACM 158-161, 2012

25 Ferguson, R., "Social learning analytics: five approaches" ACM 23-33, 2012

26 Kulyk, O., "Situational awareness support to enhance teamwork in collaborative environments" ACM 5-, 2008

27 Santos, J. L., "Scaling up Learning for Sustained Impact" Springer Berlin Heidelberg 314-327, 2013

28 Bakharia, A., "SNAPP: a bird's-eye view of temporal participant interaction" ACM 168-173, 2011

29 Dawson, S., "SNAPP : Realising the affordances of real-time SNA within networked learning environments" 2010

30 Long, P., "Penetrating the fog : Analytics in learning and education" 46 (46): 30-32, 2011

31 Ji, M., "Open Learning and Teaching in Educational Communities" Springer International Publishing 440-445, 2014

32 Jovanović, J., "Ontologies for effective use of context in e-learning settings" 10 (10): 47-59, 2007

33 Mazza, R., "Monitoring an online course with the GISMO tool : A case study" 18 (18): 251-265, 2007

34 Verbert, K., "Learning dashboards : an overview and future research opportunities" 18 (18): 1499-1514, 2014

35 Howlin, C., "Learning and Academic Analytics in the Realizeit System" AACE 862-872, 2014

36 Wise, A. F., "Learning analytics for online discussions: a pedagogical model for intervention with embedded and extracted analytics" ACM 48-56, 2013

37 Verbert, K., "Learning analytics dashboard applications" 2013

38 Verbert, K., "Learning analytics dashboard applications" 57 (57): 1500-1509, 2013

39 Elias, T., "Learning analytics Definitions, processes and potential" 23 : 134-148, 2011

40 Simsek, D., "Learning Analytics Beyond Learning Management Systems: Proposing a Learner Dashboard which collects, analyzes and reports learner-generated data from social networking sites" University of Southampton 2012

41 Fortenbacher, A., "LeMo: A learning analytics application focussing on user path analysis and interactive visualization" 12-14, 2013

42 Bajzek, D., "Inventing the Digital Dashboard for Learning" 1084-1092, 1084

43 Tobarra, L., "Integrated Analytic dashboard for virtual evaluation laboratories and collaborative forums" IEEE 1-6, 2014

44 Few, S., "Information dashboard design" O'Reilly Media, Inc 2006

45 Brown, W. E., "Improving the feedback cycle to improve learning in introductory biology using the digital dashboard" AACE 1030-1035, 2006

46 Wolff, A., "Improving retention by identifying and supporting “at-risk” students" 2012

47 Essa, A., "Improving Student Success Using Predictive Models and Data Visualisations" 20 : 58-70, 2012

48 Dix, A., "Human-computer interaction" Prentice Hall 1998

49 Softic, S., "Human Factors in Computing and Informatics" Springer Berlin Heidelberg 74-90, 2013

50 Garrard, J., "Health sciences literature review made easy: The matrix method" Jones &Bartlett 2007

51 Kimmerle, J., "Group awareness and self-presentation in computer-supported information exchange" 3 (3): 85-97, 2008

52 Santos, J. L., "Goal-oriented visualizations of activity tracking: a case study with engineering students" ACM 143-152, 2012

53 Mazza, R., "Gismo: a graphical interactive student monitoring tool for course management systems" 1-8, 2004

54 Leony, D., "GLASS: a learning analytics visualization tool" ACM 162-163, 2012

55 Mazza, R., "Exploring usage analysis in learning systems: Gaining insights from visualisations" 65-72, 2005

56 Ifenthaler, D., "Encyclopedia of educational technology" SAGE Publications, Inc 447-451, 2015

57 Rada, R., "Efficiency and effectiveness in computer-supported peer-peer learning" 30 (30): 137-146, 1998

58 Torniai, C., "E-learning meets the social semantic web" IEEE 389-393, 2008

59 Park, Y., "Development of the Learning Analytics Dashboard to Support Students'Learning Performance" 21 (21): 110-133, 2015

60 Dyckhoff, A. L., "Design and implementation of a learning analytics toolkit for teachers" 15 (15): 58-76, 2012

61 Ji, M., "DDART: an Awareness System to Favor Reflection during Project-Based Learning" 81-83, 2014

62 Willis, P., "Cultural production is different from cultural reproduction is different from social reproduction is different from reproduction" 12 (12): 48-67, 1981

63 Jovanović, J., "Creating New Learning Experiences on a Global Scale" Springer Berlin Heidelberg 112-126, 2007

64 Mazza, R., "CourseVis : A graphical student monitoring tool for supporting instructors in web-based distance courses" 65 (65): 125-139, 2007

65 Arnold, K. E., "Course signals at Purdue: using learning analytics to increase student success" ACM 267-270, 2012

66 Viégas, F. B., "Chat circles" ACM 9-16, 1999

67 Murray, T., "Brief Overview of Social Deliberative Skills" 1-6, 2013

68 Dourish, P., "Awareness and coordination in shared workspaces" ACM 107-114, 1992

69 Pallotta, V., "Automatic argumentative analysis for interaction mining" 2 (2): 77-106, 2011

70 Duval, E., "Attention please!: learning analytics for visualization and recommendation" ACM 9-17, 2011

71 Kurosu, M., "Apparent usability vs. inherent usability: experimental analysis on the determinants of the apparent usability" ACM 292-293, 1995

72 Llora, X., "Analyzing active interactive genetic algorithms using visual analytics" ACM 1417-1418, 2006

73 Clow, D., "An overview of learning analytics" 18 (18): 683-695, 2013

74 Tractinsky, N., "Aesthetics and apparent usability: empirically assessing cultural and methodological issues" ACM 115-122, 1997

75 Santos, J. L., "Addressing learner issues with StepUp!: an Evaluation" ACM 14-22, 2013

76 Campbell, J. P., "Academic analytics" 1-20, 2007

77 Festinger, L., "A theory of social comparison processes" 7 (7): 117-140, 1954

78 Fulantelli, G., "A semantic approach to mobile learning analytics" ACM 287-292, 2013

79 Chatti, M. A., "A reference model for learning analytics" 4 (4): 318-331, 2012

80 Ali, L., "A qualitative evaluation of evolution of a learning analytics tool" 58 (58): 470-489, 2012

81 Murray, T., "A prototype facilitators dashboard: assessing and visualizing dialogue quality in online deliberations for education and work" 2013

82 Gutwin, C., "A descriptive framework of workspace awareness for real-time groupware" 11 (11): 411-446, 2002

83 Iandoli, L., "A debate dashboard to enhance online knowledge sharing" 42 (42): 67-93, 2012

84 Yang, S. J. H., "A Social Network-based System for Supporting Interactive Collaboration in Knowledge Sharing over Peer-to-Peer Network" 66 (66): 36-50, 2008

85 Asadi, M., "A Quantitative Evaluation of LOCO-Analyst: A Tool for Raising Educators' Awareness in Online Learning Environments"

86 Gemignani, Z., "A Guide to Creating Dashboards People Love to Use"

87 Murray, T., "A Dashboard for Visualizing Deliberative Dialogue in Online Learning" 2013

88 Michel, C., "21st Century Learning for 21st Century Skills" Springer Berlin Heidelberg 250-263, 2012