Aziida Nanyonga, Hassan Wasswa, Oleksandra Molloy, Ugur Turhan, G. Wild
{"title":"Natural Language Processing and Deep Learning Models to Classify Phase of Flight in Aviation Safety Occurrences","authors":"Aziida Nanyonga, Hassan Wasswa, Oleksandra Molloy, Ugur Turhan, G. Wild","doi":"10.1109/TENSYMP55890.2023.10223666","DOIUrl":null,"url":null,"abstract":"This study focuses on the classification of safety occurrences in the air transport system using natural language processing (NLP) and artificial intelligence (AI) models. The researchers utilized ResNet and sRNN deep learning models to classify flight phases based on unstructured text narratives of safety occurrence reports from the NTSB. The study evaluated the performance of these models using a dataset of 27,000 safety occurrence reports and found that both models achieved an accuracy exceeding 68%, surpassing the random guess rate of 14% for the seven-class classification problem. Additionally, the models exhibited high precision, recall, and F1 scores. Notably, the sRNN model outperformed the simplified ResNet model architecture used in the study. These findings suggest that NLP and deep learning models can effectively extract flight phase information from raw text narratives, enabling the thorough analysis of safety occurrences in the aviation industry.","PeriodicalId":314726,"journal":{"name":"2023 IEEE Region 10 Symposium (TENSYMP)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE Region 10 Symposium (TENSYMP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/TENSYMP55890.2023.10223666","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
This study focuses on the classification of safety occurrences in the air transport system using natural language processing (NLP) and artificial intelligence (AI) models. The researchers utilized ResNet and sRNN deep learning models to classify flight phases based on unstructured text narratives of safety occurrence reports from the NTSB. The study evaluated the performance of these models using a dataset of 27,000 safety occurrence reports and found that both models achieved an accuracy exceeding 68%, surpassing the random guess rate of 14% for the seven-class classification problem. Additionally, the models exhibited high precision, recall, and F1 scores. Notably, the sRNN model outperformed the simplified ResNet model architecture used in the study. These findings suggest that NLP and deep learning models can effectively extract flight phase information from raw text narratives, enabling the thorough analysis of safety occurrences in the aviation industry.