New IoT(Internet of Things) and smart home devices has been rapidly commercialized in recent years. These products not only learn user’s context and usage pattern but also interact with its physical environment. Therefore, users of these devices go ...
New IoT(Internet of Things) and smart home devices has been rapidly commercialized in recent years. These products not only learn user’s context and usage pattern but also interact with its physical environment. Therefore, users of these devices go through diverse experiences depending on usage period, other products using with and physical or social environment.
Experiments and surveys were the preferred methods for evaluating user experience. However, these methodologies have limits concerning the context. Experiments or surveys differs alienated from its actual context of usage. Also, experiments and surveys are conducted after short-term usage. The user experience of IoT or such products are affected by its context and environment, which leaves the existing methodologies hard to evaluate its user experience properly.
This research proposes topic modeling, which is one of text mining algorithm, as an alternative method for evaluating user experience. To demonstrate this, this research conducted a case study referring to online reviews of Amazon Echo, which is connected home device with intelligent agent. By analyzing online reviews with the topic modeling algorithm, this research discovers key features which affect user experience and satisfaction. The results show that online reviewers evaluate Echo with 5 aspects overall: speaker, connected home, voice interaction, update and other functions. Short term updates had the most positive impact on user satisfaction.
This research makes an implication by proposing a new method of evaluating user experience. Topic modeling has two advantages. First, it is cost/time efficient compared with other qualitative research methods. It also enables statistic analysis of unstructured text data. Many companies looking forward to launching a new product can apply this method to evaluate their user’s experience in an early stage. Also, this research has its academic significance in that it evaluates user experience of connected home device which is rarely researched.