공개소프트웨어 서비스 평가모델(BSEM)에 관한 개념적 연구

이승창,박훈성,서응교 한국유통과학회 2015 유통과학연구 Vol.13 No.1

Purpose - Open source software has high utilization in most of the server market. The utilization of open source software is a global trend. Particularly, Internet infrastructure and platform software open source software development has increased rapidly. Since 2003, the Korean government has published open source software promotion policies and a supply promotion policy. The dynamism of the open source software market, the lack of relevant expertise, and the market transformation due to reasons such as changes in the relevant technology occur slowly in relation to adoption. Therefore, this study proposes an assessment model of services provided in an open source software service company. In this study, the service level of open source software companies is classified into an enterprise-level assessment area, the service level assessment area, and service area. The assessment model is developed from an on-site driven evaluation index and proposed evaluation framework; the evaluation procedures and evaluation methods are used to achieve the research objective, involving an impartial evaluation model implemented after pilot testing and validation. Research Design, data, and methodology - This study adopted an iteration development model to accommodate various requirements, and presented and validated the assessment model to address the situation of the open source software service company. Phase 1 - Theoretical background and literature review Phase 2 - Research on an evaluation index based on the open source software service company Phase 3 – Index improvement through expert validation Phase 4 – Finalizing an evaluation model reflecting additional requirements Based on the open source software adoption case study and latest technology trends, we developed an open source software service concept definition and classification of public service activities for open source software service companies. We also presented open source software service company service level measures by developing a service level factor analysis assessment. The Behavior-Structure-Evolution Evaluation Model (BSEM) proposed in this study consisted of a rating methodology for calculating the level that can be granted through the assessment and evaluation of an enterprise-level data model. An open source software service company’s service comprises the service area and service domain, while the technology acceptance model comprises the service area, technical domain, technical sub-domain, and open source software name. Finally, the evaluation index comprises the evaluation group, category, and items. Results - Utilization of an open source software service level evaluation model For the development of an open source software service level evaluation model, common service providers need to standardize the quality of the service, so that surveys and expert workshops performed in open source software service companies can establish the evaluation criteria according to their qualitative differences. Conclusion - Based on this evaluation model’s systematic evaluation process and monitoring, an open source software service adoption company can acquire reliable information for open source software adoption. Inducing the growth of open source software service companies will facilitate the development of the open source software industry.

서비스디자인 특화 평가모델 개발연구

이향은 ( Lee Hyang Eun ) 한국기초조형학회 2018 기초조형학연구 Vol.19 No.5

소비자들이 기업을 평가하는 요소로 제품은 물론 서비스에 대한 만족도가 중요한 작용을 하고 있다. 이에 다양한 층위에서 고객과의 접점을 기획하고 관리하는 차별화된 서비스디자인의 가치가 중대해지며 서비스경영의 시대로 진입하고 있다. 서비스디자인은 사용자에게 새로운 혹은 보다 나은 경험을 제공함으로써 신규가치를 창출할 수 있는 혁신의 요소가 되었다. 과거 서비스에 대한 평가는 주로 경제학이나 산업공학적 측면에서 이루어져 왔다. 디자인적 사고(Design Thinking)에 입각해 서비스를 감성적인 영역으로 확대하여 소비자들의 서비스 품질에 대한 만족도를 심층적으로 측정할 수 있다면 이는 서비스경영의 시대에 제품의 경쟁우위 검증으로도 활용될 수 있을 것이다. 하지만 단순히 서비스 품질만을 평가하는 모델과 방법론은 존재하나 ‘감성적 접근’ 과 ‘다양한 입장’이 중요한 서비스디자인의 취지와 프로세스를 수용하고 반영하는 서비스디자인 평가 모델은 연구가 미비한 실정이다. 이에 서비스디자인 본연의 가치를 지표화한 평가 모델 개발로 서비스디자인 연구의 폭을 넓히고 더욱 발전할 수 있는 토대를 만들기 위해 본 연구를 수행하게 되었다. 본 연구를 위한 연구방법으로는 일차적으로 기존의 서비스 평가모델들을 분석하여 서비스평가에 필요한 필수요소를 도출하였다. 서비스디자인의 특성을 적극 반영하기 위해 서비스디자인의 5원칙Sequencing, Holistic, User Centered, Co-creation, Evidencing의 단계별 특징을 인지하고 정성평가의 주요가이드라인으로 설정하였으며, 서비스디자인의 프로세스에 입각해 평가모델의 전체 구조를 설계하였다. 또한 서비스디자인의 감성적 특성을 구별 지을 수 있도록 서비스 라이프사이클을 3단계로 나누고 각 단계별로 이해관계자 그룹과의 교차분석을 통해 라이프사이클에 따른 이해관계자별 검증요소를 도출하였다. 본 연구의 결론인 서비스디자인 특화평가모델은 첫째 디자인의 전문영역으로서의 서비스디자인에 특화된 평가모델 개발을 위해 기초연구와 기획에 서비스디자인의 특징이 반영되었고, 둘째 감성어휘에 제한되어 있던 정성평가에 고객감성을 척도화 하는 새로운 방법을 제시했으며, 셋째 기업에서 실제로 활용할 것을 염두에 두고 실용성을 기준으로 서비스디자인 특화 정량·정성 평가모델이 설계되었다. 추후 실제 기업에서 제공되는 제품/서비스를 접하는 사용자를 대상으로 설계된 구조의 정량조사와 정성조사를 실시하여 측정항목 및 측정내용에 대한 수정사항을 보완하고, 보다 정확하고 의미 있는 조사결과를 얻을 수 있는 서비스디자인 특화 평가모델을 완성시키고자 한다. 서비스디자인 특화 정량/정성 평가모델의 개발완성을 위해 본 연구를 기반으로 지속적인 후속연구가 진행 중이다. Consumers' satisfaction with their products and services is a key factor in evaluating a company. Therefore, the value of differentiated service design that plans and manages touch points with customers becomes significant, and it is gradually watching the arrival of the era of service management. Service design has become an element of innovation that can create value by providing users with new experiences. In the past, the evaluation of services has mainly been performed in economics or industrial engineering. If we can extend the service to the emotional area based on the design thinking and measure the satisfaction of the consumers' service quality in depth, it can be used as the product competitive advantage test in the era of service management. There are models and methodologies that only evaluate service quality, but there are few types of research on service design - specific evaluation models that reflects the purpose and process of service design which ‘emotional approach’ and ‘various position’ are important. Therefore, it is necessary to develop an evaluation model which indexes the value of service design. For this study, I analyzed the existing service evaluation models and derive essential elements for service evaluation. In order to positively reflect the characteristics of service design, the 5 principles of service design are set as the guideline of qualitative evaluation features of Sequencing, Holistic, User Centered, Co-creation, and Evidencing. The service lifecycle was divided into three stages so that the emotional characteristics of the service design could be distinguished, and the verification factors of each stakeholder according to the life cycle were derived through cross - analysis with each stakeholder group. In the case of qualitative evaluation, 5 categories of evaluation items are selected based on the five principles of service design. The service design specialization evaluation model, which is the conclusion of this study, is as follows: First, the characteristics of service design are reflected in basic research and planning to develop an evaluation model that is specialized in service design. Second, a new method to measure emotions is proposed. Thirdly, service design specific quantitative and qualitative evaluation model is designed based on practicality with consideration for practical use. In the future, I will conduct a quantitative survey and a qualitative survey of the structure designed for users who are in contact with products/services provided by actual companies, and revised to the items of measurement, Service design specialized evaluation model. Continuous follow-up research based on this research is undergoing to complete development of service design-specific quantitative/qualitative evaluation model.

어휘평가 결과를 활용한 인공지능(AI) 기반 어휘등급 조정 모델 개발 연구

최소영,장태홍,김소정 국어국문학회 2023 국어국문학 Vol.- No.203

The purpose of this study is to develop a model in which artificial intelligence (AI) adjusts the grade of the vocabulary subject to evaluation by reflecting the learner's vocabulary evaluation results. To this end, artificial intelligence that can statistically analyze the vocabulary evaluation results taken by students in '책열매', a Korean language education web service for 3rd to 6th grade elementary school students nationwide. In addition, we developed an AI model that can automatically adjust vocabulary grades by reflecting the results of vocabulary evaluation. This is a model that can adjust the vocabulary level by combining a neural network model that mimics the Rasch model for vocabulary evaluation results and a neural network model that uses vocabulary feature values. On the other hand, considering the case where it is difficult to accumulate the vocabulary evaluation results, a model that predicts the vocabulary level using only the characteristic values ​​of vocabulary without evaluation results was additionally developed. However, since this model is less accurate than the model using the lexical evaluation results, it is necessary to improve the model and reinforce the data in the future. After applying the artificial intelligence model, it will be possible to secure the qualitative validity of the adjusted vocabulary level by having it go through a suitability review by a Korean language education expert at the final stage before the execution of vocabulary evaluation. 이 연구는 인공지능(AI)이 학습자의 어휘평가 응시 결과를 반영하여 평가 대상 어휘의 등급을 조정하는 모델을 개발하는 데 목적이 있다. 이를 위해 전국 초등학교 3〜6학년 학생을 위한 국어교육 웹서비스인 ‘책열매’에서 학생들이 응시한 어휘평가 결과를 통계적으로 분석하고, 어휘평가 결과를 반영하여 어휘등급을 자동으로 조정할 수 있는 인공지능 모델을 개발하였다. 이는 어휘평가 결과에 대한 라쉬 모델을 모사한 신경망 모델과 어휘 특징값을 활용하는 신경망 모델을 결합하여 어휘등급을 조정할 수 있는 모델이다. 한편 어휘평가 결과가 축적되기 어려운 경우도 고려하여, 평가 결과 없이 어휘의 특징값만을 활용해서 어휘등급을 예측하는 모델도 추가적으로 개발하였다. 그러나 이것은 어휘평가 결과를 활용하는 모델에 비하여 정확도가 낮으므로 추후 모델 개선 및 데이터 보강이 필요하다. 인공지능 모델을 적용한 후에는 어휘평가 실행 전의 마지막 단계에서 국어교육 전문가의 적합성 검토를 거치도록 함으로써 조정된 어휘등급의 질적 타당성을 확보할 수 있을 것이다.

A Model of Human Resources Competitiveness Based on Multi-Attribute Grey Fuzzy Comprehensive Evaluation

Shasha Yu 보안공학연구지원센터 2014 International Journal of u- and e- Service, Scienc Vol.7 No.6

Human resources are crucial in the enterprise’s development. The evaluation of the human resources competitiveness plays an important role in ensuring companies with good human resources. This paper investigates the multi-attribute evaluation of human resources competitiveness considering the characteristics of evaluation, such as complexity, multi-attribute and uncertainty. Thus, a model of human resources competitiveness based on the multi-attribute grey fuzzy comprehensive evaluation is proposed in this paper. This model has set up a multi-criteria evaluation system of human resources competitiveness of the enterprise. By analyzing quality of employee, resources inside the enterprise and potential for development of the enterprise, it creates a fuzzy evaluation model based on different criteria on evaluating human resources competitiveness and a grey relational evaluation model. A grey fuzzy comprehensive evaluation model is formed when the two models are combined together. Finally, cases are raised to prove the effectiveness and feasibility of the model and the algorithm.

전문대학의 특성을 고려한 교수업적평가 모델 연구

황일규,김경숙,권오영,안태원,박영태 한국직업교육학회 2011 職業 敎育 硏究 Vol.30 No.4

Faculty performance evaluation system has been settled down as an uncomfortable but unavoidable system, and it is one of the most important factors to grow the college competitiveness up. In this study, we selected and surveyed faculty evaluation models of several universities and colleges in Korea, and analyzed by comparing each evaluation areas of educational achievement, college-industry collaboration, research, and service. We also identified the properties of the current faculty evaluation models of the junior colleges, and derived several problems from these models such as an imitation of four-year university model, a disorders of job evaluation with respect to the attributes of classified jobs, a large variation of individual item weights, and an insufficient reflection of major characteristics. Based on these surveys and analysis, an improved faculty evaluation model for the junior college is proposed in this study. This model proposed four basic areas-educational achievement, college-industry collaboration, research, and service by considering the importance of the college-industry collaboration in the junior college-as well as the team evaluation area. Weights of the SCI-class paper was selected as a criterion for the arrangement of objective comparison of each evaluation items. We showed the integration method of several different evaluation model with respect to the attributes of classified jobs of each faculties, and evaluation plan of variational characteristics according to the majors of individuals in this model. Finally, we introduced an area fail and rating system to operate efficiently the proposed faculty evaluation model.

A Novel Evaluation Model on PLM Benefit

ZHANG Mingjing,WANG Qinghua,MO Xinnong,Zhang Li (사)한국CDE학회 2010 한국CAD/CAM학회 국제학술발표 논문집 Vol.2010 No.8

In this paper, we propose a novel PLM benefits evaluation model, including a PLM implementation-effect evaluation model and a PLM selection evaluation model. PLM implementation-effect evaluation model can evaluate PLM benefit from economic and non-economic aspect. PLM selection evaluation model can help an enterprise to find the ideal PLM solution as well as the software product which most meet the business requirement. The paper also introduces the system based on the evaluation model and its application case. The model and the system have been successfully applied in eight Chinese enterprises.

역량바탕의학교육을 촉진하기 위한 교육평가: 통합평가모형 적용

주현정,오민경,이종태,윤보영,Ju, Hyunjung,Oh, Minkyung,Lee, Jong-Tae,Yoon, Bo Young 연세대학교 의과대학 2021 의학교육논단 Vol.23 No.1

Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.

공기업과 준정부기관 경영성과의 영향요인분석: 평가지표체계와 평가방법의 변경 전후를 대상으로

라영재 한국정책분석평가학회 2019 政策分析評價學會報 Vol.29 No.4

Since the evaluation index system of SOEs and quasi-governmental organizations was based on the Malcolm Boldridge model in the United States, it was estimated that leadership factors had an effect on management and performance, as in the study of Wilson and Collier(2000), Collier (2001). As with the empirical study by Flynn and Saladin(2001) and Mellat-Parast (2015), the changes in the evaluation index system could change the relationship between management factors and management performance. In addition, since the leadership index has been replaced by strategic planning, it can be estimated that the strategic planning index also influenced the management factors and performance. In addition, the leadership and strategic planning indicators also analyzed the mediating effects of direct and indirect effects on management performance through other management factors. The results of the empirical analysis based on the results of the three-year evaluation indicators showed that in the 2013 evaluation model, leadership, financial management, remuneration management, and business management were influencing work efficiency and major business performance. In the 2014, 2015 model, strategic planning did not affect management performance. Only organizational human resources, financial budget, and business management factors had a limited effect on work efficiency and major business performance. Therefore, the preceding studies were statistically supported that leadership factors affect management and performance, and the relationship between management and management performance is changing according to the change of evaluation index. Therefore, when developing detailed sub-management indicators, the components and weights of the evaluation indicators should be determined based on theoretical prior studies, and the evaluation model should be revised through periodic verification of the suitability of the evaluation model. In addition, improving the fairness and professionalism of evaluation teams may have an effect on improving the validity and reliability of management evaluation results. 공기업과 준정부기관의 평가지표체계는 미국의 말콤볼드리지 모델을 기반으로 해서 만들어졌고 변화하고 있으므로 Wilson and Collier(2000)와 Collier(2001)의 실증연구 결과와 같이 리더십과 전략기획 요인은 경영관리와 경영성과에 영향을 주었을 것으로 추정해 볼 수 있다. 또한 Flynn and Saladin(2001)과 Mellat-Parast(2015)의 실증연구와 같이 평가지표체계가 변화하게 되면 경영관리와 경영성과와의 영향관계도 변화할 수 있다는 연구가설을 설정했다. 3개년도 평가지표의 결과값을 통해서 실증분석한 결과를 보면 2013년도 평가모델에 한해서 리더십, 재무관리, 보수관리, 주요사업관리가 업무효율과 주요사업성과에 통계적으로 유의한 영향을 주고 있었고, 2014년도, 2015년도 평가모델에서 전략기획은 경영성과에 영향을 주지 않았으며 조직인적자원, 재무예산, 주요사업관리 요인만이 업무효율과 주요사업성과에 제한적인 영향을 주고 있었다. 그리고 연도별 평가지표의 변화에 따라서 경영관리와 경영성과간의 영향관계가 변화하고 있다는 선행연구는 통계적으로 지지되고 있었다. 그러므로 세부적인 하위 평가지표를 개발할 때에는 이론적 선행연구를 바탕으로 해서 평가지표의 구성요소와 가중치를 결정해야만 하고, 주기적인 평가모델의 적합성 검증을 통해서 평가모델을 수정해야만 한다. 또한 평가단의 공정성과 전문성을 제고하는 것도 평가결과의 타당성과 신뢰도를 제고하는데 영향을 줄 수 있다.

Study on E-commerce Evaluation Model : Focused on “Internet Business Model

이영민 한국유통과학회 2016 유통과학연구 Vol.14 No.1

Purpose – Recently, the importance of rapid change in business models is more and more increasing as the change of information technology environment. Therefore, a variety of business models have emerged. On the other hand, there is no company that can generate revenue. Many enterprises are still maintained while they are changing only their appearance of the business model. Business model is important in e-commerce. However, a lot of researches are targeted only in Web sites. Thus, e-commerce companies do not have the infrastructure for measuring and business models. The purpose of paper is to evaluate factors which are related with the structuring of the e-commerce success. And it proposed a financial items and non-financial items. From the perspectives of administrators and managers, the paper researches the possibility for E-Commerce Evaluation Model as a valuable criteria in measuring business model. Research design, data and methodology – The methods are taken by the classification for the type of business-to-business transactions, transactions subject, and the degree of integration and innovation capabilities. Financial and Non-financial value is used to build E-Commerce Evaluation Model. Evaluation items in Administration's perspective are composed with enhance the effectiveness of the mission, improving efficiency of the administration, and control of costs. Evaluation items in the customer's perspective were measured by customer participation and cooperation with customer Satisfaction. In the case of researching the information system's perspective, three criteria are used such as adequacy of the development process, improvement of the quality of service, and maintenance of standardized information technology. In researching for the ICT competence's perspective, evaluation items were composed of enhanced user capabilities, utilizing new technologies, and empowerment of information workers. Results – In this paper, E-Commerce Evaluation Model with financial and non-financial perspectives shows the possibility to be criteria in the case of measuring business model. Moreover, it gives the positive expectation to be successful criteria. But the research may have ambiguity in its essential concept because it cannot avoid the limitation in selecting evaluation tools from merely the model. It is impossible to exclude the possibility in omitting specific properties which may take place in actual case study. Therefore, In hereafter research, it is necessary to include actual case study research in selecting evaluation tools in order to improve the limit point. Actual measurement items which are derived from actual case study should be subdivided, and it would be more effective to complete the research. Conclusions – In rapid change in business models, there are various kinds of business models. But it is general situation that companies which adopted business models have not brought in revenue. For this reason, E-Commerce Evaluation Model is needed as an important factor for the structuring of the e-commerce success. Although it has the limitation in selecting evaluation tools from model, E-Commerce Evaluation Model proposes the implication for measuring business models as a valuable criteria.

Rasch모형을 적용한 필드하키 선수의 포지션별 경기력 평가모형 개발

이정재,박재현,전민수,윤효준 한국체육측정평가학회 2020 한국체육측정평가학회지 Vol.22 No.2

The purpose of this study is to develop a performance evaluation model by position for field hockey players. Specifically, evaluation variables were selected for each position to evaluate performance of field hockey players, and finally, a performance evaluation model considering the importance of evaluation variables was developed. In order to select the evaluation variables by position, the research was conducted through preceding research on the field hockey and the open questionnaire for athletes, and then a professional group was formed to select 10 performance evaluation variables by position. A survey was conducted on 149 field hockey players to calculate the importance of the evaluation variables, and the difficulty value of the evaluation variables was calculated using the Rasch model. Finally, the weight of the evaluation variable was calculated by applying the extended Angoff method. The result of this study is as follow. First, attacker's performance evaluation model is Y = 6.00 (positioning) + 5.25 (trapping) + 4.58 (shielding) + 4.10 (press) + 3.98 (forehand shooting) + 3.86 (moving) + 3.50 (dribble) + 3.32 (tackle) + 3.02 (pass) + 1.00 (reverse shooting). Second, mid-fielder’s performance evaluation model is Y = 4.00 (positioning) + 2.95 (man to man) + 2.74 (trapping) + 2.26 (hit) + 2.26 (scoop) +1.80 (moving) + 1.59 (slap hit) + 1.28 (dribble) + 1.00 (tackle). Third, defender’s performance evaluation model is Y = 4.00 (man to man) + 3.85 (pass) + 3.36 (hit) + 2.30 (tackle) + 2.30 (scoop) + 1.89 (press escape) + 1.85 (trapping) + 1.32 (shielding) + 1.30 (slap hit) + 1.00 (push). It is expected to be used as a basic data for fair selection of players as well as improvement of their performance through a reasonable evaluation of players' performance in the field hockey field. 이 연구의 목적은 필드하키 선수의 포지션별 경기력 평가모형을 개발하는 것이다. 구체적으로 필드하키 선수의 경기력 평가를 위해 포지션별 평가변인을 선정하였으며, 최종적으로 평가변인의 중요도를 고려한 경기력 평가모형을 개발하고자 하였다. 포지션별 평가변인을 선정하기 위해 필드하키 선행연구와 선수들에게 개방형 설문지를 통해 조사를 실시하였으며, 이후 전문가집단을 구성하여 포지션별 경기력 평가변인 10개를 선정하는 절차를 거쳤다. 평가변인의 중요도를 산출하기 위해 필드하키 선수 149명을 대상으로 설문조사를 실시하였으며, Rasch 모형을 적용하여 평가변인의 난이도값을 산출하였다. 최종적으로 확장된 Angoff 방법을 적용하여 평가변인의 가중치를 산출하였다. 이 연구의 결과는 다음과 같다. 첫째, 공격수의 경기력 평가모형은 Y = 6.00(위치선정) + 5.25(트래핑) + 4.58(쉴딩) + 4.10(프레스) + 3.98(포핸드슛팅) + 3.86(무빙) + 3.50(드리블) + 3.32(태클) + 3.02(패스) + 1.00(리버스슛팅) 이다. 둘째, 미드필더의 경기력 평가모형은 Y = 4.00(위치선정) + 2.95(맨투맨) + 2.74(트래핑) + 2.26(히트) + 2.26(스쿱) + 1.80(무빙) + 1.63(푸쉬) + 1.59(슬랩히트) + 1.28(드리블) + 1.00(태클) 이다. 셋째, 수비수의 경기력 평가모형은 Y = 4.00(맨투맨) + 3.85(패스) + 3.36(히트) + 2.30(태클) + 2.30(스쿱) + 1.89(탈압박) + 1.85(트래핑) + 1.32(쉴딩) + 1.30(슬랩히트) + 1.00(푸쉬) 이다. 이는 필드하키 현장에서 타당한 선수 경기력평가를 통해 공정한 선수 선발은 물론 경기력 향상에 기초자료로 활용되길 기대한다.