Generative AI models have rapidly advanced in recent years, enabling creative and productive use of information across various domains. At the center of this progress are Large Language Models (LLMs), which have evolved into powerful tools capable of ...
Generative AI models have rapidly advanced in recent years, enabling creative and productive use of information across various domains. At the center of this progress are Large Language Models (LLMs), which have evolved into powerful tools capable of search, analysis, and task automation. However, their increasing adoption has highlighted the persistent challenge of hallucination—instances where models generate inaccurate or unverifiable information. Retrieval-Augmented Generation (RAG) has emerged as a promising solution to mitigate this issue, particularly within the defense sector, where closed-network operations and the need for domain-specific language models are critical. Despite this potential, research on the application of RAG-LLM systems in defense environments remains limited.
This study proposes a RAG-LLM–based AI system designed to support defense technology research and development (R&D) project planning. Using Request for Proposals (RFP) data from a component localization development support project, we implemented a LangChain-based RAG architecture under multiple experimental conditions and integrated it with an LLM to design a task-oriented AI planning system through prompt engineering techniques. Evaluation of the system demonstrated that, when responding to project-planning inquiries, it produced accurate answers with high promptness, matching the original document information. These findings suggest that the system can effectively support planning processes in defense technology R&D. However, due to the limited dataset and the use of only a single document for validation, future research should expand the system to diverse and extensive planning-related documents to enhance reliability and practical applicability.