{"title":"基于机器视觉的飞机座舱指示器自动识别系统","authors":"Jiaqing Yao, Renwen Chen, Yijun Huang","doi":"10.1145/3573834.3574549","DOIUrl":null,"url":null,"abstract":"Aiming at the problem that the test of civil aircraft is greatly affected by human factors in the batch manufacturing process, the automatic identification system of aircraft cockpit indicators based on machine vision is researched. Firstly, the slant screen images are automatically corrected and segmented by image processing technology. Secondly,different methods are used to identify different regions according to the specificity of different regions in the images. YOLOv5 algorithm is used for target detection of unconventional indicators; EasyOCR algorithm is used for character recognition, especially in decimal recognition, this research improved EasyOCR, in which using the projection of the legal decimal point position and cover at the data input end, modify the initial characteristics, to avoid the wrong identification interference of the decimal point. At the output end, the correct decimal point is reset between digits. The accuracy is improved by 27.65% and the average accuracy is 96.60%; Other general indicators recognition, using common image processing techniques, such as Hough transform, HSV color matching, etc. Experimental results show that the average error rate of identification results of various indicators is only 1.96%, the speed of machine recognition is 4.8 times that of manual test. Compared with manual test, it can effectively solve the problems of misjudgment, heavy workload and inefficient, and improve the degree of automation in the batch production process of civil aircraft.","PeriodicalId":345434,"journal":{"name":"Proceedings of the 4th International Conference on Advanced Information Science and System","volume":"123 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Automatic identification system of aircraft cockpit indicators based on machine vision\",\"authors\":\"Jiaqing Yao, Renwen Chen, Yijun Huang\",\"doi\":\"10.1145/3573834.3574549\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Aiming at the problem that the test of civil aircraft is greatly affected by human factors in the batch manufacturing process, the automatic identification system of aircraft cockpit indicators based on machine vision is researched. Firstly, the slant screen images are automatically corrected and segmented by image processing technology. Secondly,different methods are used to identify different regions according to the specificity of different regions in the images. YOLOv5 algorithm is used for target detection of unconventional indicators; EasyOCR algorithm is used for character recognition, especially in decimal recognition, this research improved EasyOCR, in which using the projection of the legal decimal point position and cover at the data input end, modify the initial characteristics, to avoid the wrong identification interference of the decimal point. At the output end, the correct decimal point is reset between digits. The accuracy is improved by 27.65% and the average accuracy is 96.60%; Other general indicators recognition, using common image processing techniques, such as Hough transform, HSV color matching, etc. Experimental results show that the average error rate of identification results of various indicators is only 1.96%, the speed of machine recognition is 4.8 times that of manual test. Compared with manual test, it can effectively solve the problems of misjudgment, heavy workload and inefficient, and improve the degree of automation in the batch production process of civil aircraft.\",\"PeriodicalId\":345434,\"journal\":{\"name\":\"Proceedings of the 4th International Conference on Advanced Information Science and System\",\"volume\":\"123 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 4th International Conference on Advanced Information Science and System\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3573834.3574549\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 4th International Conference on Advanced Information Science and System","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3573834.3574549","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Automatic identification system of aircraft cockpit indicators based on machine vision
Aiming at the problem that the test of civil aircraft is greatly affected by human factors in the batch manufacturing process, the automatic identification system of aircraft cockpit indicators based on machine vision is researched. Firstly, the slant screen images are automatically corrected and segmented by image processing technology. Secondly,different methods are used to identify different regions according to the specificity of different regions in the images. YOLOv5 algorithm is used for target detection of unconventional indicators; EasyOCR algorithm is used for character recognition, especially in decimal recognition, this research improved EasyOCR, in which using the projection of the legal decimal point position and cover at the data input end, modify the initial characteristics, to avoid the wrong identification interference of the decimal point. At the output end, the correct decimal point is reset between digits. The accuracy is improved by 27.65% and the average accuracy is 96.60%; Other general indicators recognition, using common image processing techniques, such as Hough transform, HSV color matching, etc. Experimental results show that the average error rate of identification results of various indicators is only 1.96%, the speed of machine recognition is 4.8 times that of manual test. Compared with manual test, it can effectively solve the problems of misjudgment, heavy workload and inefficient, and improve the degree of automation in the batch production process of civil aircraft.