A Study on Deep Reinforcement Learning Framework for DME Pulse Design

다국어 초록 (Multilingual Abstract)

The Distance Measuring Equipment (DME) is a ground-based aircraft navigation system and is considered as an infrastructure that ensures resilient aircraft navigation capability during the event of a Global Navigation Satellite System (GNSS) outage. The main problem of DME as a GNSS back up is a poor positioning accuracy that often reaches over 100 m. In this paper, a novel approach of applying deep reinforcement learning to a DME pulse design is introduced to improve the DME distance measuring accuracy. This method is designed to develop multipath-resistant DME pulses that comply with current DME specifications. In the research, a Markov Decision Process (MDP) for DME pulse design is set using pulse shape requirements and a timing error. Based on the designed MDP, we created an Environment called PulseEnv, which allows the agent representing a DME pulse shape to explore continuous space using the Soft Actor Critical (SAC) reinforcement learning algorithm.

참고문헌 (Reference)

1 Haarnoja, T., "Soft Actor-Critic Algorithms and Applications"

2 Euiho Kim, "SFOL Pulse: A High Accuracy DME Pulse for Alternative Aircraft Position and Navigation" MDPI AG 17 (17): 2183-, 2017

3 Federal Aviation Administration (FAA), "Performance- Based Navigation (PBN) National Airspace System (NAS) Navigation Strategy 2016" U.S. Department of Transportation 2016

4 Kim, E, "Investigation of APNT Optimized DME/ DME Network Using Current State-of-the-Art DMEs: Ground Station Network, Accuracy, and Capacity" 2012

5 Euiho Kim, "Improving DME Performance for APNT Using Alternative Pulse and Multipath Mitigation" Institute of Electrical and Electronics Engineers (IEEE) 53 (53): 877-887, 2017

6 Lilley, R. W, "DME/DME for Alternative Position, Navigation, and Timing (APNT), APNT White Paper" Department of Transportation 2012

7 Kim, E., "Alternative DME/N pulse shape for APNT" 2013

8 Badia, A., "Agent57: Outperforming the Atari Human Benchmark"