에이전트 기반 시뮬레이션을 통한 디스패칭 시스템의 강화학습 모델 = A Reinforcement Learning Model for Dispatching System through Agent-based Simulation

다국어 초록 (Multilingual Abstract)

In the manufacturing industry, dispatching systems play a crucial role in enhancing production efficiency and optimizing pro- duction volume. However, in dynamic production environments, conventional static dispatching methods struggle to adapt to various environmental conditions and constraints, leading to problems such as reduced production volume, delays, and resource wastage. Therefore, there is a need for dynamic dispatching methods that can quickly adapt to changes in the environment. In this study, we aim to develop an agent-based model that considers dynamic situations through interaction between agents. Additionally, we intend to utilize the Q-learning algorithm, which possesses the characteristics of temporal difference (TD) learning, to automati- cally update and adapt to dynamic situations. This means that Q-learning can effectively consider dynamic environments by sensi- tively responding to changes in the state space and selecting optimal dispatching rules accordingly. The state space includes information such as inventory and work-in-process levels, order fulfilment status, and machine status, which are used to select the optimal dispatching rules. Furthermore, we aim to minimize total tardiness and the number of setup changes using reinforcement learning. Finally, we will develop a dynamic dispatching system using Q-learning and compare its performance with conventional static dispatching methods.

참고문헌 (Reference)

1 "The AnyLogic Company"

2 김현호 ; 김정훈 ; 공주회 ; 경지훈, "Reinforcement Learning-based Dynamic Weapon Assignment to Multi-Caliber Long-Range Artillery Attacks" 45 (45): 42-52, 2022

3 남소현 ; 조영인 ; 우종훈, "Reinforcement Learning for Minimizing Tardiness and Set-Up Change in Parallel Machine Scheduling Problems for Profile Shops in Shipyard" 60 (60): 202-211, 2023

4 Levine, S., "Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Review"

5 Kim, S. J., "Real-time scheduling using CNN on a parallel machine with setup cost" 1385-1401, 2018

6 유우식 ; 김성재 ; 김관호, "Real-Time Scheduling Scheme based on Reinforcement Learning Considering Minimizing Setup Cost" 25 (25): 15-27, 2020

7 "Hanbat National University"

8 Zhang, Z., "Flow Shop Scheduling with Reinforcement Learning" 2013

9 Priore, P., "Dynamic scheduling of manufacturing systems using machine learning: An updated review" 28 (28): 83-97, 2014

10 조영인 ; 남소현 ; 우종훈, "Development of the Reinforcement Learning-based Adaptive Scheduling Algorithm for Panel Block Shop" 26 (26): 81-92, 2021

11 조영인 ; 오승헌 ; 곽동훈 ; 최재호 ; 우종훈, "Development of Quay Scheduling Algorithm Based on Reinforcement Learning" 27 (27): 98-114, 2022

12 Waschneck, B., "Deep reinforcement learning for semiconductor production scheduling" 301-306, 2018

13 최효원 ; 변희재 ; 윤수한 ; 김보성 ; 홍순도, "Analysis of Workforce Scheduling Using Adjusted Man-machine Chart and Simulation" 47 (47): 20-27, 2024

14 강봉권 ; 강병민 ; 홍순도, "A Dynamic OHT Routing Algorithm in Automated Material Handling Systems" 45 (45): 40-48, 2022