과학 실험 평가 도구 개발을 통한 탐구 능력 평가의 타당화에 관한 연구

우종옥,이항로,김승훈 한국교원대학교 과학교육연구소 1997 청람과학교육연구논총 Vol.7 No.1

The purpose of this study is to develop a valid and reliable instrument, applicable to high school Earth Science class experiment. In advance of developing items, I was selected 14 inquiry process skills and specified evaluative objectives for each of them to develop scales and criteria for them. I developed 28 evaluation items for 5 experiment subjects among those of high school Earth Science class. The first field trial was performed a sample of 5 high school students, and the second one using a sample of 25 high school students. The results are as follows. (1) The content validity and reliability(Cronbach α) of the developed items were 82.7% and .86, respectively, the developed instrument in this study is considered valid and reliable. (2) The average difficulty index was .69 and the discrimination index was .30. (3) Answer sheets based on the reported results were rated 5 teachers and Inter-rater Reliabilitiy and Inter-rater Consistency were analyzed, its indices were .80 and .76, respectively. (4) The developed items show a low coefficient of .45 with TESIS, a set of paper-and-pencil test items developed by Lee, Hang-Ro(1991). That the experiment assessment is solely subject to the rater's viewpoint has been one of the major problems raised concerning the matter. This research, however, shows that a set of more specified scales and criteria for the evaluation will make it more valid, reliable and efficient.

고등학생의 지구과학 탐구능력 측정을 위한 평가도구 개발

우종옥,이항로 한국교원대학교 과학교육연구소 1995 청람과학교육연구논총 Vol.5 No.1

Since the late of 1960,s, the improvement of science inquiry skills has been one of the most important goals in secondary science education. To achieve this goal, it is essential to develop a valid and reliable instrument for evaluating science inquiry skills. The purpose of this study is to develop a valid and reliable instrument for evaluating science inquiry skills for high school students. The instrument is developed through R & D procedure, which includes two field trials of the instrument. This study has formed a clear definition of the elements of science inquiry skills (formulating a hypothesis, controlling variables, designing an experiment, numeric calculation, graphing experimental data, inference, determining relationship, determining causalities, predicting experimental results 〈including interpolation and extrapolation〉, drawing a conclusion, formulating a generalization or model), and established the goals of assessment and developed the items of assessment. The instrument, Test of Earth Science Inquiry Skills, consists of 33 items which measure 11 science inquiry skills. There are content-free items for each science inquiry skills. This study has selected 11 science inquiry skills which are considered appropriate for being evaluated by paper-and-pencil test with SIEI (Hur, 1984). The content validity of items, objectivity of the scoring keys and clarity of the items were checked by six experienced specialists in science education. At the same time, the two field trials has been executed and produced the reliability of the instrument, item difficulty index, and the effectiveness of distracters. The first field trial was performed using a sample of 304 high school students, and the second one using a sample of 872 high school students. Because the content validity is 84% and the reliability (K-R 20) is 0.84, the developed instrument in this study is considered valid and reliable. The difficulty index is 49.4%, answer ratio 59.1%, the discrimination index 0.47 and the effectiveness of distracters evenly distributed, which also suffice the criteria of good instrument. The developed instrument in this study can diagnosis the well-developed science inquiry skills and the ill-developed science inquiry skills of the students, and trace the degree of the improvement of science inquiry skills.

초등학교 고학년 학생의 과학 탐구능력 측정을 위한 평가 도구 개발

송경혜,이항로,임청환 한국과학교육학회 2004 한국과학교육학회지 Vol.24 No.6

본 연구에서는 평가도구의 구비조건을 갖춘 초등학교 고학년 학생의 과학탐구능력을 측정할 수 있는 과학탐구 능력 평가도구를 개발하고자 하였다. 평가도구를 구성하는 문항은 R&D 방법에 의해 개발되었으며, 2차례에 걸친 과학교육 전문가의 점검과 2번의 현장 검증을 통해 문항을 수정ㆍ보완하였다. 각 평가 문항은 교과 내용에 대한 지식이 없어도 해결할 수 있는 범교과적인 문항으로 제작하여 과학탐구능력의 하위 요소들을 측정하고자 하였다. SAPA 교육과정과 제7차 과학과 교육과정에서 제시한 과학탐구과정 요소를 근간으로 관찰, 분류, 측정, 예상, 추리, 문제인식, 변인통제, 자료해석, 결론도출, 실험설계의 10가지 하위 요소들을 선정하고 각 요소에 대한 조작적 정의와 평가 목표를 설정하였다. 물질과 에너지, 생명과 환경, 지구와 순환의 3가지 내용 영역의 소재를 중심으로 총 30문항을 개발하였다. 개발된 문항을 과학교육 전문가에게 2회 의뢰하여 타당도, 객관도, 문항의 명료성을 점검 받았으며 2번의 현장 검증을 통해 신뢰도, 변별도, 난이도를 검증하였다. 그 결과 타당도 91.6%, 신뢰도 지수 Cronbach α값 0.79, 객관도 93.3%, 변별도 지수 0.30, 난이도 지수 66.1%로 나타났다. 위와 같은 값들은 평가도구가 갖추어야 할 구비조건의 허용 범위내에 있는 것으로 보아 본 연구에서 개발한 과학탐구능력 평가도구는 양호한 것으로 볼 수 있다. 따라서 본 연구에서 개발한 과학탐구능력 평가도구는 초등학생들의 과학탐구능력 성취 수준의 진단, 과학과 교육과정과 교수?학습 자료 및 과학과 교수ㆍ학습 방법의 과학탐구능력 반영 수준을 평가하는 도구로도 이용될 수도 있을 것이다. The purpose of this study is to develop a valid and reliable evaluating instrument for elementary school fifth and sixth graders. The instrument is developed through R&D procedure, which includes two checks of science specialist and two field trials of the instrument. Evaluating items are content-free for each science inquiry skill. Each science inquiry element is based on SAPA and the 7th curriculum. This study has selected 10 science inquiry skills(observing, classifying, measuring, predicting, inferring, recognizing of a problem, controlling variables, interpreting data, drawing a conclusion, designing an experiment), formulated a clear definition of the elements of science inquiry skills, and established the objectives of evaluation. The content areas are divided into three categories, material and energy, life and environment, and the earth and circulation. Each category contains 10 items. So the instrument consists of 30 items. The content validity of items, objectivity of the scoring keys, and clarity of the items has been checked twice by specialists in science education. At the same time, two field trials were performed to produce the reliability of the instruments, discrimination index, and item difficulty index. The instrument has the content validity is 91.6%, reliability 0.79, objectivity 93.3%, discrimination index 0.30, and item difficulty index 66.1%.

科學 探究能力 評價 問題 類型 變化에 關한 縱斷的 硏究

우종옥,이항로,구창현 한국교원대학교 과학교육연구소 1996 청람과학교육연구논총 Vol.6 No.1

This study investigated the literature about science process skills' evaluation to analyse transition of evaluation objectives before and after a Scholastic Ability Test for College Entrance. In the literature survey the researcher established a 3 dimensional science assessment framework with X axis as science concept, Y axis as science process skills and Z axis as problem context. In order to analysis and compare each items the researcher selected 210 items from the 1st to the 7th trials and 138 items from the 1st to 4th Scholastic Ability Test for College Entrance and sampled 2873 science achievement test items from 10 high schools. In accordance with this taxonomy the researcher analysed and compared science process skills item forms. The following results were drawn: The items were evenly distributed in all the four areas(Earth Science, Biology, Physics and Chemistry) of the science concept domain, but they were heavily concentrated on data analysis and drawing a conclusion in science process domain. In the domain of problem context school context was the majority. In spite of distribution like this the ratio on science process skills measurement items and science achievement test items was increased after the Scholastic Ability Test for College Entrance was given. Also the ratio on item expression type was increased. Item form was almost 5 options selection type in the national level test. Although there were 4 options selection type, 5 options selection type, short answer type, essay type in school level test, rising from 33.1% to 65.5% on 5 options selection type is exhibited. This study showed that the school level item form was better various than the nation level. This point like this is the evidence for the improvement toward the science process skills test and influenced by Scholastic Ability Test for College Entrance. The ratio on the item which joined with the 3 axes had a mean of 99.3% in nation level test and mean 44.9% in school achievement test level. But the ratio in the school achievement test level increased after the Scholastic Ability Test for College Entrance was given. In view of this study we must furthermore study the item types which can evaluate validately science process skill's five stage each and evaluation method by the high school students' problem solving patterns and features in scientific inquiry on all science process skills elements.

계통도를 이용한 중·고등학생의 지구와 달의 운동에 관한 개념 유형 연구

우종옥,이항로,민준규 한국교원대학교 과학교육연구소 1995 청람과학교육연구논총 Vol.5 No.1

In spite of school science learning, the students' conceptions have not been changed easily. Therefore, to make students overcome their non scientific conceptions has been an important issue in science education. The purpose of this study was to identify the conceptions of students and teachers on the motion of the earth and the moon. The instrument was developed for estimating students' understandings of the concepts related to the motion of the earth and the moon. The validity of the instrument was examined by the specialists in Science Educator and Astronomer. At the same time, the two field trials had been executed, and the items were modified. Also, it consists of 12 items including 9 two-tier multiple choice items and 3 multiple choice items. The population of this study consists of 250 eighth-, 299 tenth-, 292 eleventh-grade students, 134 science teachers in secondary school. SPSS/PC+ was adopted for the statistical analysis. The type of misconceptions possessed students were as follows: 1) At 12:00 noon, the sun is directly overhead. 2) First quarter moon is a half of overall surface of the moon. 3) Air don't rotate with the earth surface because it keeps apart from the earth surface. 4) Summer is warmer than winter, because the earth is nearer from the sun in summer. 5) Whenever season is changed, the direction of rotation axis of the earth is changed. 6) The moon is the brightest at the position of new moon, because the distance between the moon and the sun is the shortest and the moon is received strongest sunlight. 7) The moon is not seen at the position of real full moon, because it is covered with shadow of the earth. 8) When the moon is not seen in the earth, sunlight is not reached at the moon. The major findings were as follows: 1) The middle school students had more misconceptions than those of high school students. And female students had more misconceptions than those of male ones. 2) The rate of correct answer and the type of conception in the tenth grade students were very similar with eleventh grade students. 3) The higher cognitive level, the better development of scientific conception and the less misconception. Also, the correlation coefficient between scientific conception score and GALT score was 0.57. 4) The students in scientific part had higher the rate of correct answer than those of students in human part and the former had less misconception than the latter. 5) The rate of correct answer about model and figure items was lower than descriptive ones, because they did not understand about figures itselves. These types of misconceptions will be used for science instruction and studies of other conceptions need.

大學 修學 能力 試驗의 自然科學 探究 能力 評價를 爲限 行動 要素의 抽出과 評價 目標의 상세화 硏究 II

禹鍾玉,李杭魯,李京勳 한국교원대학교 과학교육연구소 1992 청람과학교육연구논총 Vol.2 No.1

The purpose of the study is to specify the evaluative objectives of science process skills and to serve as an evaluative criterion for the development of university competency test. The followings are the results of this study. (1) Five steps as a teaching and learning model of science are suggested for the improvement of science inquiry skills. (2) Three dimensional taxomony was presented to evaluate the science process skills of university competency test. (3) Sixteen behavioral elements were selected from the science process model and defined operationally. (4) 146 evaluative objectives were specified according to each behavioral element based on the results presented above, the science inquiry model and the evaluative objectives will be contributed to teaching and learning strategies for the improvement of science process skills including basic concepts and contents, and problematic situation in science.

과학교육학 목표에 관한 연구

우종옥,이항로,이경훈 한국교원대학교 과학교육연구소 1994 청람과학교육연구논총 Vol.4 No.1

The purpose of this study was to establish the goals of Science Pedagogy as a subject curriculum. This study is served as the criterion for syllabus of teacher's university which instruct the preservice science teachers. To perform this study, by a premise of Science Pedagogy, the domains and the categories of science educational goals ware pursued by review of literature. In this study, the sources to establish science educational goals are national educational ideology, nature of science, interests and cognitive levels of children, and social demands. According to these sources, the domains of science educational goals are as follows: 1.cognitive domain 2.inquiry process domain 3.manual skills domain 4.creativity domain 5.science attitude domain 6.S-T-S domain These six domains are essential to school science educational achievement. Therefore, these domains are surely reflected in the course of science preservice teacher's training. On the base of these domains of science educational goals, 1 general goal and 10 specific objectives of Science Pedagogy are proposed.

ADAS Test Strategies and Platform-based Testing Methods of Global Automotive OEM & Tier 1

Hang-Ro Lee(이항로) 한국자동차공학회 2018 한국자동차공학회 Workshop Vol.2018 No.7

학습부진아 지원 정책 운영과정에 대한 질적 사례연구

조항로(Cho Hang-Ro),김병찬(Kim Byeong-Chan) 한국교육행정학회 2012 敎育行政學硏究 Vol.30 No.4

학교자율경영제 관점에서 본 자율형 사립고 운영과정에서의 동형화와 디커플링 현상 분석 : A 자율형 사립고 사례

조항로(Cho Hang-Ro),김병찬(Kim Byeong-Chan) 한국교육행정학회 2013 敎育行政學硏究 Vol.31 No.4