The purpose of this study was to develop the reliable and valid evaluation tool of evaluating and selecting e-learning platforms, or learning management systems. To achieve that goal, factor analysis, reliability analysis and formative evaluation have...
The purpose of this study was to develop the reliable and valid evaluation tool of evaluating and selecting e-learning platforms, or learning management systems. To achieve that goal, factor analysis, reliability analysis and formative evaluation have been adopted. With total 81 items developed through the criteria framework, a survey was carried out among 163 e-learning experts in order to ensure how important they are. To derive a concise list of explanatory constructs from the responses collected from 133 respondents, exploratory factor analysis(EFA) was performed. As a result of it, two main factors(factor 1, factor 2) were extracted. Factor 1 was labeled instruction management, screen design & technology and factor 2 interaction & evaluation. And factor 1 and factor 2 were respectively interpreted consisting of four sub-factors and three ones. Confirmatory factor analysis(CFA) was carried out to assess the degree to which the plausibility of factor models is empirically confirmed, Overall fit measures (RMSEA, CFI, NNFI), indexes that show the suitablility of the model were quite good. Reliability estimates using Cronbach`s alpha indicated that the evaluation tool had good internal consistency. The formative evaluation of three Korean platforms was performed. One-way ANOVA and post-hoc multiple comparison were conducted with the responses collected from 65 respondents. And during that evaluation, several problems including the ambiguity of items happened. But it seemed that most of them were derived from the indirect evaluation method by using CD-ROM. They were not critical in deciding that the evaluation tool itself is valid and reliable. It is concluded that the evaluation tool for e-Learning platforms is very valid and reliable.