Application of Makeup Image Optimization Recommendation System through the Analysis of BeautyGAN Based on Deep Learning

다국어 초록 (Multilingual Abstract)

The purpose of this study was to identify the makeup preference of users and suggest a method to optimize the makeup style by using the preferred image for each age group through the analysis of BeautyGAN. Through this, you can propose a customized makeup style that suits you, and provide beneficial services to the makeup industry and consumers. In addition, by developing and validating new methods that effectively combine deep learning and vision systems, we aim to innovate makeup-related image conversion technology and contribute to academic and practical advances in this field. For this purpose, reference images suitable for each image were collected to implement image optimization for each age group, the input data reflected the researcher’s image, and the face was aligned and resized, after removing images with low resolution or poor lighting conditions. As a result of the performance evaluation of the BeautyGAN model, it was confirmed that the existing image was 51.26%, which is close to the BeautyGAN image of 38.89%. These results are judged to be able to provide customized makeup style suggestions or adjusted makeup effects that reflect the user’s preferences from an academic point of view, and from a practical point of view, it will be possible to improve the quality of customized beauty services by suggesting makeup styles that suit the characteristics of customers more accurately and quickly.

참고문헌 (Reference)

1 Arjovsky, M., "Wasserstein Generative Adversarial Networks" 70 : 214-223, 2017

2 Zhu, J. Y., "Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks" 2223-2232, 2017

3 반세나, "Trends and Case Study of Beauty Tech Industry" 2 (2): 22-32, 2022

4 이윤경, "The age of 4.0 industry, the ICT convergence in fashion industry" 23 (23): 497-507, 2017

5 Li, S., "The Internet of Things: A Survey" 17 : 243-259, 2015

6 Choi, Y. J., "StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation" 8789-8797, 2018

7 Jo, Y. J., "Research Trends of Generative Adversarial Networks and Image Generation and Translation" 35 (35): 91-102, 2020

8 Ledig, C., "Photo-Realistic Single Image Super-ResolutionUsing a Generative Adversarial Network" 4681-4690, 2017

9 Lim, S. H., "Makeup transfer using on facial segmentation loss function based BeautyGAN" Kyonggi University 2022

10 Sun, Z., "Local facial makeup transfer via disentangled representation" 459-473, 2020

11 Kim, T. S., "Learning to discover cross-domain relations with generative adversarial networks" 161-202, 2017

12 Wei, Z., "Learning adaptive receptive fields for deep image parsing network" 2434-2442, 2017

13 Gu, Q., "Ladn: Local adversarial disentangling network for facial makeup and de-makeup" 10480-10489, 2019

14 Isola, P., "Image-to-Image Translation with Conditional Adversarial Nets" 1125-1134, 2017

15 Wang, T. C., "High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs" 8798-8807, 2018

16 Goodfellow, I., "Generative adversarial networks" 63 (63): 139-144, 2020

17 Rostamzadeh, N., "Fashion-gen: The generative fashion dataset and challenge"

18 Tong, W. S., "Example-Based Cosmetic Transfer" 2007

19 Zhao, J., "Energy-based generative adversarial networks" 2017

20 Hwang, S. H., "Development of a Web Service for Cosmetics Recommendation based on an Artificial Intelligence for User Personal Color Generation" 31 (31): 461-463, 2023

21 Byun, J., "Design and Implementation of Image Recommender System using Personal Preference Image based on Deep Learning" Sangmyung University 2017

22 Li, T., "BeautyGAN: Instance-Level Facial Makeup Transfer with Deep Generative Adversarial Network" 26 (26): 645-653, 2018

23 Berthelot, D., "BEGAN: Boundary Equilibrium Generative Adversarial Networks"

24 김상열 ; 김현태, "Artificial intelligence(AI) Composition Technology Trends & Creation Platform" 44 (44): 207-228, 2022

25 Xu, L., "An automatic framework for example-based virtual makeup" 2013

26 Perera, C., "A Survey on Internet of Things from Industrial Market Perspective" 2 : 1660-1679, 2013

27 Karras, T., "A Style-Based Generator Architecture for Generative Adversarial Networks" 4401-4410, 2019