In this paper, we have implemented a framework that simply writes a pre-processing task and a simple driver function without re-defining the task of querying and pre-processing data from the DB and storing it in the DB every time. It consists of a sys...
In this paper, we have implemented a framework that simply writes a pre-processing task and a simple driver function without re-defining the task of querying and pre-processing data from the DB and storing it in the DB every time. It consists of a system that divides the preprocessing part and the part stored in the DB and modularizes each task and function. This makes it possible to process lost data at a faster rate. Also, in the multi-processing process, when each process is finished, it is not stopped and the next task can be executed immediately, so that no time is wasted. It also facilitates deployment by configuring the configuration software as a docker container. Also, to distribute the design pattern and framework configuration system, the container structure that builds the execution environment of the application was applied using docker and docker-compose, which are open source platforms.