A High-Dimensional Dynamic Characteristics-Based Boundary Test Scenario Generation Method for UAVs in Dynamic Target Tracking

Abstract

Effective boundary scenario generation methods are critical for dynamic target tracking when evaluating the performance of unmanned aerial vehicles. However, traditional methods primarily rely on exhaustive testing or random sampling and often assume that different contributing factors are independent. This results in the ineffective generation of boundary scenarios and a lack of realism. In this study, a novel high-dimensional dynamic characteristics-based boundary test scenario generation method is proposed using reinforcement learning (RL). Boundary test scenarios can be explored more purposive, by designing an appropriate reward function. First, an innovative scenario modeling method is developed to model the influence of environment, occlusion, and other interference. A joint distribution model of the key correlation factors, such as light intensity and clouds, is also established. This ensures scenario authenticity and test accuracy. Subsequently, a high-dimensional dynamic spatial Markov decision process (HDDS-MDP) model is constructed to facilitate the generation of boundary scenarios based on the scenario modeling. Ultimately, RL is employed to solve the HDDS-MDP model and generate boundary test scenario, thereby substantially improves the effectiveness of boundary test scenario generation. The simulation results indicate that the boundary test scenario generation effectiveness is improved by 91% over random sampling methods.