Xin Tan, Jingshu Zhong, Yu Jin, Yan Liang, Yu Zheng, Ying Liu
{"title":"机组操作手册智能QA系统的设计与研究","authors":"Xin Tan, Jingshu Zhong, Yu Jin, Yan Liang, Yu Zheng, Ying Liu","doi":"10.1115/detc2022-90768","DOIUrl":null,"url":null,"abstract":"\n Aviation flight crews rely on a large number of complex standard documents and operation manuals when performing flight tasks. In order to relieve the pressure of manual retrieval of documents, intelligent question-answering technology based on reading comprehension is gradually applied. In this paper, the flight crew operation manual SQuAD dataset is studied and built, based on which the reader-retriever framework of text content-based reading question answering system (TCQA) is analyzed and established. Experiments are conducted to compare the relevant indexes of the QA system with different combinations of reader and retriever models under the open-source tool haystack. Based on the comparison of response speed and retrieval capability, the best model combination is obtained for the flight crew operation manual dataset, and suggestions are made for the model-related performance improvement.","PeriodicalId":382970,"journal":{"name":"Volume 2: 42nd Computers and Information in Engineering Conference (CIE)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Design and Research of Intelligent QA System for Flight Crew Operating Manual\",\"authors\":\"Xin Tan, Jingshu Zhong, Yu Jin, Yan Liang, Yu Zheng, Ying Liu\",\"doi\":\"10.1115/detc2022-90768\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n Aviation flight crews rely on a large number of complex standard documents and operation manuals when performing flight tasks. In order to relieve the pressure of manual retrieval of documents, intelligent question-answering technology based on reading comprehension is gradually applied. In this paper, the flight crew operation manual SQuAD dataset is studied and built, based on which the reader-retriever framework of text content-based reading question answering system (TCQA) is analyzed and established. Experiments are conducted to compare the relevant indexes of the QA system with different combinations of reader and retriever models under the open-source tool haystack. Based on the comparison of response speed and retrieval capability, the best model combination is obtained for the flight crew operation manual dataset, and suggestions are made for the model-related performance improvement.\",\"PeriodicalId\":382970,\"journal\":{\"name\":\"Volume 2: 42nd Computers and Information in Engineering Conference (CIE)\",\"volume\":\"38 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-08-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Volume 2: 42nd Computers and Information in Engineering Conference (CIE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1115/detc2022-90768\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Volume 2: 42nd Computers and Information in Engineering Conference (CIE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1115/detc2022-90768","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Design and Research of Intelligent QA System for Flight Crew Operating Manual
Aviation flight crews rely on a large number of complex standard documents and operation manuals when performing flight tasks. In order to relieve the pressure of manual retrieval of documents, intelligent question-answering technology based on reading comprehension is gradually applied. In this paper, the flight crew operation manual SQuAD dataset is studied and built, based on which the reader-retriever framework of text content-based reading question answering system (TCQA) is analyzed and established. Experiments are conducted to compare the relevant indexes of the QA system with different combinations of reader and retriever models under the open-source tool haystack. Based on the comparison of response speed and retrieval capability, the best model combination is obtained for the flight crew operation manual dataset, and suggestions are made for the model-related performance improvement.