Reinforcement Learning-Based Collision Avoidance Guidance Algorithm for Fixed-Wing UAVs

Yu Zhao, Jifeng Guo, Chengchao Bai, Hongxing Zheng, Zhile Yang
2021 Complexity  
A deep reinforcement learning-based computational guidance method is presented, which is used to identify and resolve the problem of collision avoidance for a variable number of fixed-wing UAVs in limited airspace. The cooperative guidance process is first analyzed for multiple aircraft by formulating flight scenarios using multiagent Markov game theory and solving it by machine learning algorithm. Furthermore, a self-learning framework is established by using the actor-critic model, which is
more » ... oposed to train collision avoidance decision-making neural networks. To achieve higher scalability, the neural network is customized to incorporate long short-term memory networks, and a coordination strategy is given. Additionally, a simulator suitable for multiagent high-density route scene is designed for validation, in which all UAVs run the proposed algorithm onboard. Simulated experiment results from several case studies show that the real-time guidance algorithm can reduce the collision probability of multiple UAVs in flight effectively even with a large number of aircraft.
doi:10.1155/2021/8818013 fatcat:xezl64j7zfeatkwik2lfy2j5le