In the field of social science, it is very important to be confident about the reliability and validity of evaluation. The reliability of evaluation is generally divided into two dimensions, inter-rater reliability and reliability of the instrument. I...
In the field of social science, it is very important to be confident about the reliability and validity of evaluation. The reliability of evaluation is generally divided into two dimensions, inter-rater reliability and reliability of the instrument. Inter-rater reliability is a measure of consistency and agreement between separate evaluators rating the same piece of behavior or situation. High levels of consistency and agreement indicate high inter-rater reliability. The purpose of this study is to review the inter-rater reliability of a performance appraisal system which is one of the most fundamental systems in Human Resource Management(HRM) in public corporation. As well, recommendations are made for establishing a sound performance appraisal system. The results of this study show that there was little inter-rater agreement. That is, inter-rater reliability was unacceptably low. To improve inter-rater reliability, we have to find ways to train evaluators so that their ratings are closer to each other. The results also imply that the Rating Scale Method should be less favored than the BARS(Behaviorally Anchored Rating Scales) to reduce rating errors. It is imperative to have a systematic understanding of a performance appraisal to maximize the effectiveness of HRM in the context of the new HRM paradigm.