{"title":"Towards Trajectory Conflict Prediction Using AI/ML For V&V Test Case Generation","authors":"Wyatt Mingus, L. Sherry, J. Shortle","doi":"10.1109/ICNS58246.2023.10124252","DOIUrl":null,"url":null,"abstract":"System Verification and Validation Testing (V&V) for time-dependent systems requires the generation of test cases. Each test case is defined by a set of initial conditions and an expected outcome at the end of the specified time period. Traditional methods for generating V&V test-cases run simulations of the system to generate outcomes for each combination of initial conditions. Due to the combinatorics of even a small set of initial conditions, covering the complete combinatorics can be time and/or cost prohibitive.This paper evaluates the feasibility of using Deep Learning Neural Networks (DLNN) to generate additional test cases that were not generated by the simulations due to time limitation. A DLNN trained to on the subset of test-cases from the simulation, learns the underlying behavior of the system, and is used to generated additional test cases. A case study for using DLNN to predict test-cases for trajectory conflicts demonstrates the feasibility of this approach for time-dependent systems that exhibit bounded, deterministic behavior. The implications of these results, the limitations, and future work are discussed.","PeriodicalId":103699,"journal":{"name":"2023 Integrated Communication, Navigation and Surveillance Conference (ICNS)","volume":"73 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 Integrated Communication, Navigation and Surveillance Conference (ICNS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICNS58246.2023.10124252","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
System Verification and Validation Testing (V&V) for time-dependent systems requires the generation of test cases. Each test case is defined by a set of initial conditions and an expected outcome at the end of the specified time period. Traditional methods for generating V&V test-cases run simulations of the system to generate outcomes for each combination of initial conditions. Due to the combinatorics of even a small set of initial conditions, covering the complete combinatorics can be time and/or cost prohibitive.This paper evaluates the feasibility of using Deep Learning Neural Networks (DLNN) to generate additional test cases that were not generated by the simulations due to time limitation. A DLNN trained to on the subset of test-cases from the simulation, learns the underlying behavior of the system, and is used to generated additional test cases. A case study for using DLNN to predict test-cases for trajectory conflicts demonstrates the feasibility of this approach for time-dependent systems that exhibit bounded, deterministic behavior. The implications of these results, the limitations, and future work are discussed.