다기준 의사결정 방법을 활용한 사용자 경험의 평가 방법 = User Experience Evaluation Method using Multi-Criteria Decision Making

다국어 초록 (Multilingual Abstract)

Objective: This study was conducted for the purpose of proposing a method to evaluate user experience for a system using a multi-criteria decision making model based on the evaluation factors of user experience.
Background: User experience refers to a direct or indirect experience that a user obtains in the process of using a product or service. As various digital products and services become popular and competition intensifies in modern life, user experience is becoming more and more important. Various studies have been attempted to evaluate user experience according to such necessity. Since the user experience that an individual has for the same system can be different, it is important how the user experience evaluation of the system incorporates this subjectivity.
Method: In this study, a method to obtain the user experience score was proposed by using importance weights of the user experience evaluation criteria and averaging the scores for each evaluation criterion of the system. To this end, we first determined the criteria for evaluating user experience based on the honeycomb model. AHP was used as a method to derive the relative importance weight of evaluation criteria. In addition, a Likert scale from 1 to 5 was used to give a rating for the user experience evaluation criteria.
Results: In order to examine the applicability of the method proposed in this study, it was applied to the user experience evaluation problem for car rental websites.
In this study, 'useful, usable, findable, credible, desirable, accessible, and valuable' presented in the honeycomb model were used as user experience evaluation criteria.
Both the UX score and the SUS score showed a statistically significant difference at the significance level of 0.05 for each of the three car rental websites. A similar pattern was also observed in the average score. And the UX score showed a significant correlation with the SUS score of 0.509.
Conclusion: User experience evaluation using the multi-criteria decision-making method showed a high correlation with SUS, which has been used as an effective usability evaluation method in many studies. From this fact, it can be seen that the user experience evaluation method proposed in this study can be effectively applied to the user experience evaluation problem of a system.
Application: The results of this study could be used as a method to evaluate user experience on a digital system.

참고문헌 (Reference)

1 류시천 ; 최진영 ; 심미희, "스마트 애플리케이션 UX 디자인 평가 접근 방법" (사)한국스마트미디어학회 8 (8): 70-79, 2019

2 고은성 ; 김승인, "배달 애플리케이션을 통한 사용자 경험 비교분석 -배달의 민족, 요기요, 배달통을 중심으로-" 한국디지털정책학회 17 (17): 393-399, 2019

3 Mandryk, R.L, "Using psychophysiological techniques to measure user experience with entertainment technologies" 25 (25): 141-158, 2006

4 Ardévol, L.M, "User experience methodology for the design and evaluation of interactive systems" University of Lleida 2013

5 Han, S.H, "User experience evaluation for mobile phones and mobile services" Ministry of Education, Science and Technology of Korea 2012

6 Morville, P, "User Experience Design"

7 Hassenaahl, M, "To do or not to do: Differences in user experience and retrospective judgments depending on the presence or absence of instrumental goals" 19 : 429-437, 2007

8 Finstad, K, "The usability metric for user experience" 22 (22): 323-327, 2010

9 Tullis, T, "Measuring the User Experience" 2008

10 Hazlett, R.L, "Measuring emotional valence to understand the user's experience of software" 65 : 306-314, 2007

11 Desmet, P, "Framework of Product Experience" 1 (1): 2007

12 Bangor, A, "An Empirical Evaluation of the System Usability Scale" 24 (24): 574-594, 2008

13 Morville, P, "Ambient Findability" 54 (54): 623-626, 2006

14 Goepel, K.D, "AHP Priority Calculator"

15 Saaty, T, "A scaling method for priorities in hierarchical structures" 15 : 234-281, 1977

16 Moon, H, "A literature survey of measuring the user experience" 14-117, 2010