수업의 질 제고를 위한 강의평가 타당성 분석 : A대학 사례를 중심으로 = Analyzing the Validity and Reliability of Course Evaluations to Improve Educational Quality: A Case Study of University A

다국어 초록 (Multilingual Abstract)

This study was conducted to analyze the course evaluation system at University A and propose improvement strategies, based on the recognition of course evaluations as a key tool for managing the quality of higher education. To achieve the goal of enhancing educational quality through course evaluations, it is essential to assess not only the validity of the evaluation instrument but also the broader policy framework in which it operates. Using midterm and final course evaluation data from 2021 to 2023, this study examined the evidences of validity—based on test content, internal structure, and consequences of testing—and the reliability of the evaluation items. Based on the results, recommendations were made for improving the evaluation items and overall system. Regarding evidence based on test content, a Delphi survey with experts established consensus on the need for item revisions and identified constructs and items that were commonly deemed inappropriate. For evidence based on internal structure, confirmatory factor analysis (CFA) showed acceptable standardized factor loadings for all items except one on the final evaluation. As evidence based on test consequences, the study analyzed the bottom 5% of instructor ratings and examined patterns of inattentive responses. Reliability analysis confirmed a high level of internal consistency. Drawing on these findings, the study proposes specific directions for improvement, including enhancing construct and item validity, aligning midterm and final evaluation items, increasing the effective use of evaluation results, and addressing inattentive responding. Long-term implications for improving the course evaluation system at University A are also discussed.