국고보조사업 지원 대상 선정평가 신뢰성 개선

김난영(Nanyoyng Kim),손호성(Hosung Sohn) 한국비교정부학회 2023 한국비교정부학보 Vol.27 No.1

(Purpose) Subsidy targets for a government subsidized project are mostly selected based on the results of written evaluation and on-site evaluation by external experts. However, there is a risk that the priorities of this evaluation change depending on the subjective propensity of evaluators (e.g. generous, strict) and the reliability of the evaluation get lowered. Measuring reliability of evaluation and correcting evaluators’ subjective propensity are, therefore, needed. This study suggests the intraclass correlation coefficient (ICC) as a method to measure the reliability of the selection evaluation of subsidy targets in government subsidized projects, and proposes the use of standardized scores to increase the evaluation reliability. (Design/methodology/approach) ICC and standardized scores are identified in theoretical analysis, and then the reliability of the evaluation scores of the 2022 support targets of the Fishing Village New Deal Project, a government subsidized project, is analyzed using ICC. Lastly the rankings are recalculated using standardized score. (Findings) Written evaluation reliability was low, with the ICC of less than 0.5, and on-site evaluation reliability was also not good with the ICC of less than 0.75. When using standardized scores, 14% of the ports selected by raw scores was changed. As a result of ICC analysis on the standardized score, it was found that ICC increased. This means that when the standardized score is used, the reliability of the evaluation score increase by reducing the statistical error. (Research implications or Originality) This study suggests methods to verify and increase the reliability of the selection evaluation of the support target of government subsidized projects to improve the performance.

Unified Reliability and Its Cost Evaluation in Power Distribution Systems Considering the Voltage Magnitude Quality and Demand Varying Load Model

Yun, Sang-Yun The Korean Institute of Electrical Engineers 2003 전기학회논문지A Vol.52 No.12

In this paper, we propose new unified methodologies of reliability and its cost evaluation in power distribution systems. The unified method means that the proposed reliability approaches consider both conventional evaluation factor, i.e. sustained interruptions and additional ones, i.e. momentary interruptions and voltage sags. Because the three voltage quality phenomena generally originate from the outages on distribution systems, the basic and additional reliability indices are summarized considering the fault clearing mechanism. The proposed unified method is divided into the reliability evaluation for calculating the reliability indices and reliability cost evaluation for assessing the damage of customer. The analytic and probabilistic methodologies are presented for each unified reliability and its cost evaluation. The time sequential Monte Carlo technique is used for the probabilistic method. The proposed DVL(Demand Varying Load) model is added to the reliability cost evaluation substituting the average load model. The proposed methods are tested using the modified RBTS(Roy Billinton Test System) form and historical reliability data of KEPCO(Korea Electric Power Corporation) system. The daily load profile of the each customer type in domestic are gathered for the DVL model. Through the case studies, it is verified that the proposed methods can be effectively applied to the distribution systems for more detail reliability assessment than conventional approaches.

Reliability Evaluation of Power System Operations Considering Time-Varying Features of Components

Bo Hu,Ying Zheng,Hejun Yang,Yun Xia 대한전기학회 2015 Journal of Electrical Engineering & Technology Vol.10 No.4

The reliability of power system components can be affected by a numbers of factors such as the health level of components, external environment and operation environment of power systems. These factors also affect the electrical parameters of power system components for example the thermal capacity of a transmission element. The relationship of component reliability and power system is, therefore, a complex nonlinear function related to the above-mentioned factors. Traditional approaches for reliability assessment of power systems do not take the influence of these factors into account. The assessment results could not, therefore, reflect the short-term trend of the system reliability performance considering the influence of the key factors and provide the system dispatchers with enough information to make decent operational decisions. This paper discusses some of these important operational issues from the perspective of power system reliability. The discussions include operational reliability of power systems, reliability influence models for main performance parameters of components, time-varying reliability models of components, and a reliability assessment algorithm for power system operations considering the time-varying characteristic of various parameters. The significance of these discussions and applications of the proposed techniques are illustrated by case study results using the IEEE-RTS.

디자인 분야별 EPA,PAD 감성평가모형의 신뢰도 분석

김지혜 ( Ji Hye Kim ),이진숙 ( Jin Sook Lee ) 한국감성과학회 2014 감성과학 Vol.17 No.1

본 연구는 감성분석기법이 디자인 평가에 적극 적용되어지면서 발생할 수 있는 감성평가모형의 사용상의 오류를 최소화 하는데 연구의 목적이 있다. 제품, 실내 공간, 가로경관 디자인 분야별로 축약형 모형의 어휘 추출을 위해 선행연구에서 발췌한 어휘로 1차적인 어휘정제작업을 수행하였다. 세 분야에서 공통적으로 사용되는 어휘 19개가 나타났는데 신뢰도 분석 결과, 분야별로 신뢰도에 좋지 않은 영향을 끼치는 어휘들이 각각 다르게 나타났다. 축약형 모형인 EPA모형과 추론형 모형인 PAD모형의 신뢰도 분석을 통한 어휘 적합성을 검토하였다. 결과, 세 분야에서 축약형 모형이 추론형 모형보다 신뢰도가 높게 나타났지만, 계수의 차이가 크지 않았다. 또한 신뢰도에 좋지 않은 영향을 끼치는 어휘들을 삭제하고 신뢰도 분석 한 결과 계수의 차이가 확연히 높은 신뢰도가 나타났다. 따라서 감성평가 시에는 평가대상에 적합한 어휘 선정 과정이 필요하고, 적합한 모형을 사용하는 것이 감성평가의 객관성을 높이는 방법으로 사료된다. 추후 환경 평가에 적합한 감성평가모형의 분석이 신뢰도 검증 외에 다양한 통계기법에 의해 분석되어져야 한다. This study is aimed at minimizing the errors in using a sensitivity evaluation model that could occur when sensitivity analysis method is actively used for design evaluation. To extract words of a contrantion-type model by product, interior space, and streetscape design, primary word refinement was conducted with the words extracted from preceding studies. The analysis revealed that 19 words were used in all three fields. A reliability analysis revealed that different words had a bad impact on the reliability in each field. The applicability was reviewed through reliability analysis of EPA model as contraction-type and PAD model as inference-type. The results are as follows. Although the reliability of the contrantion-type model was higher than that of inference-type model in all three fields, the differences in Cronbach`s Alpha were small. Also, When the reliability was analyzed after deleting the words that had a bad impact on reliability, the differences in the reliability`s coefficients were clearly significant. Therefore, it is necessary to select words suitable for sensitivity evaluation target and objectivity of the evaluation can be boosted by using a proper model. Analysis of the sensitivity evaluation model suitable for future environmental evaluation should be analyzed with various statistical methods, beyond verification of reliability.

시맨틱 서비스 플랫폼상에서의 신뢰성 비교 평가 (pp.105-109)

정한민(Hanmin Jung),이미경(Mikyoung Lee),류범종(Beom-Jong You),김도완(Do-Wan Kim) 한국정보과학회 2010 정보과학회 컴퓨팅의 실제 논문지 Vol.16 No.1

정보화 사회 핵심 인프라인 웹 상에서 수많은 정보 서비스가 제공되고 있지만, 차세대 웹이라 일컫는 시맨틱 웹 기술을 활용한 시맨틱 서비스는 그 숫자나 서비스 제공 범위에 대한 공감대에 있어서 아직 성숙되지 못한 상태이다. 본 연구는 2개의 시맨틱 서비스들의 동일한 세 가지 기능들을 비교 평가하는 방식으로 시맨틱 서비스를 개발함에 있어 반드시 고려해야 할 신뢰성을 어떻게 측정할 수 있을 것인지 그 방법을 제시하고 있다. 비교 대상 시스템의 신뢰성 측정을 위해, 피실험자의 기대-결과 신뢰성과 작업 정확도 측정이 관찰자 관점에서 수행되었으며, 다른 한편으로, 기능적 신뢰성과 정보 신뢰성 스칼라 값(0~5)을 피실험자 스스로 벡터 그래프에 나타내도록 하였다. 실험결과는 관찰자에 의한 평가 값과 피실험자에 의한 평가 값이 매우 유사함을 보여 주었으며, 서비스된 정보의 정확성과 작업 수행의 만족성이 사용자 관점에서 상호 밀접한 관계를 가진다는 사실을 확인하여 주었다. 본 연구 결과를 통하여, 우리는 시맨틱 서비스가 제공하는 기능적 신뢰성과 기능 수행의 결과로 서비스되는 정보에 대한 신뢰성이 정보 시스템의 신뢰성 평가를 위한 필수적 요소임을 알 수 있었다. 특히, 신뢰성은 시맨틱 정보 서비스에서 사용상 품질 (Quality in Use)을 의미한다고 볼 수 있으며, 결과적으로 서비스의 사용상 품질을 결정하는 중요한 요소임을 실증하였다. While numerous information services are provided on the Web as a core infrastructure of information society, semantic services using the Semantic Web technologies still stay deployed number and application range. This situation would be mainly originated from the failure of securing reliability to the user. Thus, this paper introduces an evaluation method for measuring reliabilities of the semantic services comparatively. To measure the reliability of the compared systems, the observer assesses ‘precision in task performance’ as a quantitative analysis and ‘reliability of expectation-result’ as a qualitative analysis described by the test persons. On the other hand, the test person should rate the functional reliability and reliability of the served information on the vector graph by himself with a scale from 0 to 5. Experimental results show that assessment by the observer is very similar to rating value by test persons, and that the accuracy of the served information has a close effect on the functional reliability. Through this paper, we can verify the essential factors for evaluating the reliability of semantic service systems. These are functional reliability and reliability of served information resulting from function execution. In particular, it has been proven that the reliability of the semantic information services largely influences the “Quality in Use” and therefore determines the major factors of the semantic service reliability.

강의평가 도구의 타당도와 신뢰도에 관한 연구

채수진(Su-Jin Chae),장기현(Kee-Hyun Chang),강흥식(Heung-Sik Kang),김우선(Woo-Sun Kim) 한국의학교육학회 2002 Korean journal of medical education Vol.14 No.2

Purpose: The aim of this study was to analyze the instruction evaluation questionnaires that have been used by the Department of Radiology, Seoul National University College of Medicine, 2001, and to determine a means to improve them. Methods: This study used (1) a factor analytic technique to identify the instructional factors that determine the correlation between all pairs of the evaluation items. (2) A procedure known as Cronbach s alpha, which allows the internal consistency of the instruction evaluation items to be estimated. (3) A correlation method to compare the instruction evaluation score results among the students, residents, peer faculties and the faculty itself. Results: The results were summarized as follows: First, the Instruction Evaluation Questionnaire included 12 items, 6 comprising a teaching method connected with the lecturer factor and the other 6 a teaching method connected with the teaching resource factor. Second, the Cronbach s α index was found to be 0.91s. This indicates the high reliability of the items of the questionnaire for the instruction evaluation. Third, it was found that the correlation between the evaluators was very low (r=.345). In particular, the average score of the peer faculties was 3.33, which was lower when compared with the average score of other evaluators. Conclusion: There is no concordant opinion regarding the evaluation items that should be used in an instruction evaluation in a Medical College. However, the instruction evaluation items should consider various factors connected with the teaching and learning activity. There is a need to elaborate on the contents of the evaluation items in order that the instruction evaluation items be more reliable and have a greater validity.

Logit Analysis based Evaluation Model for Reliability of Software Company

최일우 한국IT정책경영학회 2017 한국IT정책경영학회 논문지 Vol.9 No.2

The existing technical evaluation methods for software development depend on the project plan to be realized, not making use of past performance record of the company. The primary factors for a project’s success are not quantitative ones like that of technical expertise, but rather qualitative ones like achievement ability, human resources, infrastructure, and customer confidence. These important factors that evaluate a software company’s reliability are being excluded from the company’s evaluations, making it necessary for devising an evaluation method that can reflect reliability at the time of the company evaluation. This study proposes a model to evaluate software companies based on Logit analysis that can evaluate reliability based on past project performance record of the company at the time of the evaluation. For the evaluation model, interviews and questionnaires were carried out based on software reliability engineering and previous study on project success factors. The GQM-based reliability estimation metric was designed from the results. In order to develop the company evaluation model that uses the defined reliability estimation metric, Logit analysis uses four assessment factors based on the statistical analysis on six assessment factors. The company assessment model is proposed from the results of the Logit analysis. The fitness of the proposed model is verified by a statistical analysis.

Bayesian Networks Application to Reliability Evaluation of Distribution Systems Containing Micro-Grids or Looped Network

Gao Liai,Zhou Yongjie,Su Kun,Hou Chenwei,Huo Limin 보안공학연구지원센터 2016 International Journal of Grid and Distributed Comp Vol.9 No.10

It is one of the effective methods to improve the reliability of the distribution system by using looped network power supply. With the development of new energy technology, distributed generation has been more widely used. But a small power system named micro-grid which is assembled by the device such as distributed generation, energy storage device and controllable load in a certain operating rules catches the attention of people. It can operate in islanded mode with the power grid failure, which can greatly improve the reliability of the system. Traditional analytical method and Monte Carlo method are difficult to evaluate its reliability accurately. In this paper, a new artificial intelligence method based on Bayesian networks is used for the system reliability analysis and evaluation. The corresponding Bayesian networks are established for the reliability test bus 2 which containing looped network and the improve reliability test bus 6 which containing micro-grids separately. With the help of causal reasoning and diagnostic reasoning, the supply influence of different types of DG output intermittent, operation mode on loads are detected, the key factors which have an impact on important load power supply reliability are found out, which is the theoretical foundation for practical engineering decision, so as to improve system reliability, identify failures and make maintenance scheduling.

On-line integration of structural identification/damage detection and structural reliability evaluation of stochastic building structures

Ying Lei,Longfei Wang,Lanxin Lu,Dan-dan Xia 국제구조공학회 2017 Structural Engineering and Mechanics, An Int'l Jou Vol.63 No.6

Recently, some integrated structural identification/damage detection and reliability evaluation of structures with uncertainties have been proposed. However, these techniques are applicable for off-line synthesis of structural identification and reliability evaluation. In this paper, based on the recursive formulation of the extended Kalman filter, an on-line integration of structural identification/damage detection and reliability evaluation of stochastic building structures is investigated. Structural limit state is expanded by the Taylor series in terms of uncertain variables to obtain the probability density function (PDF). Both structural component reliability with only one limit state function and system reliability with multi-limit state functions are studied. Then, it is extended to adopt the recent extended Kalman filter with unknown input (EKF-UI) proposed by the authors for on-line integration of structural identification/damage detection and structural reliability evaluation of stochastic building structures subject to unknown excitations. Numerical examples are used to demonstrate the proposed method. The evaluated results of structural component reliability and structural system reliability are compared with those by the Monte Carlo simulation to validate the performances of the proposed method

한문과(漢文科) 질문형(質問型) 수행평가(遂行評價)의 운영(運營)과 그 성과(成果)

송영일 ( Young Il Song ) 韓國漢字漢文敎育學會 2009 漢字 漢文敎育 Vol.22 No.-

中等學校 漢文은 `2007 개정 한문 과목 교육과정`에서 중학교는 재량선택 교과에, 고등학교는 교양 선택과목 군에 속해 있다. 새 敎育課程에서 漢文이 선택 교과인 점을 고려하여 漢文科 敎育은 교육 수요자의 관심과 요구를 적극 반영해야 하며, 지식 생성력을 배양하는 교육이 될 수 있도록 교육적 역량을 强化해야 한다. 本 硏究는 `漢文科 質問型 遂行評價의 運營과 그 成果`에 대한 現場 硏究物로써, 제1, 2차 년도의 設問調査 結果를 中心으로 요약·정리해 보면 다음과 같다. 첫째, 效果的인 授業 活動을 가능케 하였다. 敎授·學習 活動 中 유창성과 융통성, 비지시성, 명확성, 효율적 의사소통 면에서 교육적 성과를 낳았다. 둘째, 學習動機와 興味 誘發에 효과적이었다. 학습내용 면에서는 지식·이해와 문제해결력 등에, 학습태도 면에서는 학습자의 동기와 흥미 유발에 敎育的 效果가 높았다. 셋째, 遂行評價의 役割을 强化하였다. 旣存 漢文科 遂行評價는 대부분 한자쓰기와 수업태도 등에 비중을 두고 운영한 사례가 많았다. 본 연구에서는 질문기술 개발과 다양한 질문유형 등을 활용하여 학습자의 능동적 수업 참여와 흥미도를 높여 수행평가의 역할을 强化하였다. 漢文科 敎育에서 質問 授業은 敎科 敎育의 立地를 더욱 견고히 해 줄 수 있으며, 授業의 質을 한 차원 끌어올릴 수 있는 原動力이 되어 줄 것이다. 특히 漢文科 質問型 遂行評價는 교수·학습 방법과 수행평가에 대한 竝行 硏究로, 第7次 改正 敎育課程期 수요자 중심 교육에 순응하고 학습자의 흥미와 호기심을 자극하여 교수·학습의 효과를 倍加시킬 수 있는 최적의 授業 模型 硏究라는 점에서 그 意義는 매우 크다. The question-answer type of performance evaluation of Sino-Korean subject is the combination of question-answer classes and performance evaluation, and is the synthetic observation and evaluation of the responses and thinking process of learners, such as understanding, problem-solving capability, and creativity of the Sino-Korean classes of learners. It was progressed in the order of the whole rangle of planning and application, and input and operation of the question-answer type of performance evaluation of Sino-Korean subject. Based on the analysis of the questionnaires, this study aimed to find out the effect and problems, and the strength and weakness in terms of the contents, methods, and evaluation of teaching and learning of the question-answer type of performance evaluation. The results of this study are summarized as follows. First, as for the contents, they can be classified into the contents of Sino-Korean subject and Hanja phrases besides the subject. the question-answer type of performance evaluation was implemented, focusing on the phrases besides the subject in 1st year, and on the contents of the subject in the 2nd year. In the result of the questionnaires, the question-answer type of performance evaluation focusing on the phrases showed higher validity and reliability than the contents of the subject. This result shows that the contents of questions and the academic level of learners of that year were not the same as those of the previous year, and when the question-answer type of performance evaluation is conducted only focusing on the phrases, it is required to supplement and have measures as the education course of Sino-Korean subject can be carelessly handled. Second, as for the methods, the question-answer type of performance evaluation was more effective in inducing interest and motivation, attention, the communication between teachers and students, and the improvement of problem-solving capability, compared with other performance evaluation methods. In contrast, there was a relatively lower support in the areas of the understanding of the concept and principle of the contents of the subject, and the creativity, arrangement and integration of learners. It seems that the training of question-suggesting techniques of teachers, and the systemic research of teaching and learning method can supply the good clues of solving problems. Third, as for evaluation, the performance evaluation of Sino-Korean subject was mostly made up of the evaluation of writing, attitude, short-query, and portfolio, and the question-answer type of performance evaluation similar to this study was not almost implemented. Seeing the result of the questionnaires of 1st, 2nd year on the question-answer performance evaluation, 92.01% of learners answered that it was more effective, compared with other performance evaluation methods, which means that the question-answer type of performance evaluation of Sino-Korean subject is very successful, and the educational availability of the subject in the performance evaluation of Sino-Korean subject will increase in the future. Considering the results of this study, the question-answer type of performance evaluation made Sino-Korean subject class vital by stimulating the curiosity of learners, and made learners have interest and confidence in Sino-Korean classes by raising the degree of attending classes of the learners. And also, it created the chances to review and integrate the contents of the study that the learners learned before, and made the need and academic level of students diagnosed. Especially, by controlling the students effectively, it provided the conditions for us to hold the class, and in that it is possible for teachers to evaluate their classes, there is a meaning of this study. However, as it is easy to have a class focusing on the excellent students, difficult to have consistency and integration of thinking, and question items are exposed according to the time difference of classes, there is a problem that the reliability of evaluation can be dropped. Also, it is not easy to acquire the question-suggesting techniques for proceeding the question-answer type of performance evaluation, and it is required to take complementary measures as the poor operation of the question-answer type of performance evaluation can lower the quality of the class by making the object of subject study unclear, and the education course of Sino-Korean subject can be carelessly handled. With the knowledge-based society of 21C coming on, to make Sino-Korean Subject as a major one which succeeds to and develops our traditional culture and recreates the life and wisdom of ancestors, the position of subject education should be strengthened. Also, to do that, it is necessary for us to seek the improvement in quality of Sino-Korean education through the deepened research and spread of the various evaluation models, such as this kind of the question-answer type of performance evaluation.