NCS Communication Skill Performance Assessment Instrument: A Reliability and Usability Test

다국어 초록 (Multilingual Abstract)

Most of colleges have made efforts to adapt National Competency Standards (NCS) into their education system by developing and offering courses about NCS vocational competencies such as communication skills. However, instructors are suffering from teaching NCS vocational competencies. In specific, they are having difficulty in assessing students’ achievement due to a lack of objectivity and consistency of existing assessment instruments of NCS vocational competency. In a preceding study, the researchers developed a performance assessment instrument to assess NCS communication skills. The assessment instrument for document comprehension skills and document writing skills were developed for descriptive assessments and essay assessments instrument and the assessment instrument for listening comprehension skills and linguistic expression skills were developed in the form of tester checklists and testee checklists. The purpose of this study is to test the reliability and usability of the developed NCS communication skills performance assessment instrument. In order to test the reliability of NCS communication skill assessment instrument, Cronbach α and the reliability of evaluators were examined. The usability of the performance assessment instrument was tested by three instructors who were teaching communication courses. As the result of analyzing the Cronbach α, coefficient of intraclass correlation, and Cohen’s Kappa value to test the reliability, all assessment instruments showed high reliability. The result of the usability test of assessment instrument by instructors also showed high usability. In particular, we were able to identify improvement points of developed tool through interview with instructors.

목차 (Table of Contents)

• Abstract
• 1. Introduction
• 2. NCS Communication Skill Performance Assessment Instrument
• 3. Methodology
• 3.1. Reliability Verification
• 3.2. Verification of Usability
• 4. Results
• 4.1. Results of NCS Communication Performance Assessment Tool’s Reliability Test
• 4.3. Analysis Results of Evaluator Reliability Analysis
• 4.2. Results of Usability of NCS Communication Performance Assessment Instrument
• 5. Conclusion
• References