This paper attempts to examine a list of factors that account for item difficulty. An analysis has been made on the basis of identifying the characteristics both of difficult items and of easy ones in the National Assessment of Academic Achievement Ko...
This paper attempts to examine a list of factors that account for item difficulty. An analysis has been made on the basis of identifying the characteristics both of difficult items and of easy ones in the National Assessment of Academic Achievement Korean Modern and Contemporary History administered by local education authorities for the last five years.
The main findings of the analysis of the result can be summarized as follows:
The following characteristics of the items in question can be attributed to enhancing item difficulty: 1) items that reflected trivial content; 2) items that required extensive prior knowledge of the period in detail; 3) items in which comprehension of lead-in statement played an important role in identifying the correct option; 4) unconventional items that would prevent test-taking skills from having a greater influence on test performance than intended; 5) items whose key words were not explicit both in lead-in statement and in alternatives; 6) familiarity of the phrases used in alternatives; 7) items that include distracters, which are likely to be considered as correct answers.
On the other hand, the following factors did not appear to be linked with item difficulty: 1) the matter of whether the instruction and alternatives of items reflected contents drawn from more than one unit; 2) the area of items such as interpretation of historical sources and historical imagination; 3) item format such as one correct answer variety, negative variety and combined response variety; 4) the amount of content elements in each alternative.