{"title":"用于检测高空清洁机器人墙壁裂缝的混合注意机制和 RepGFPN 方法","authors":"Haiqiao Liu;Lingding Li;Ya Li;Qing Long;Zhuoyu Chen","doi":"10.1109/JPHOT.2024.3453943","DOIUrl":null,"url":null,"abstract":"Aiming at the problem that cracks with different shapes and scales on the exterior walls of high buildings are difficult to detect, this paper proposed a wall crack detection method for high-altitude cleaning robots by hybridizing the GAM attention mechanism and RepGFPN. First, the GAM attention mechanism was incorporated into the YOLOV5 backbone network to reduce information and amplify global features to improve the accuracy of feature extraction. Then, the neck network incorporated the RepFPN method to improve the descriptive ability of fused multi-scale features and to increase computational efficiency. Public datasets Concrete Crack Images for Classification, Mixed VOC2007, CrackForest-dataset-master, and UCMerced_LandUse were used for experimental validation. The ablation experiment results show that the average accuracy of mAP is improved by 13.5% after introducing the GAM attention mechanism under the yolov5 s original model, while the method in this paper (GR-YOLO) continues to improve by 4.7%. The experimental results show that the average accuracy mAP of the proposed method (GR-YOLO) is 24.0%, 47.1% and 41.0% higher than that of the model yolov5s + involution, yolov5s + p2 + involution and yolov5s + p2 + involution + CBAM, respectively. The method proposed in this article can more effectively improve the accuracy of crack detection and has important application prospects.","PeriodicalId":13204,"journal":{"name":"IEEE Photonics Journal","volume":"16 5","pages":"1-8"},"PeriodicalIF":2.1000,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10663935","citationCount":"0","resultStr":"{\"title\":\"A Hybrid Attention Mechanism and RepGFPN Method for Detecting Wall Cracks in High-Altitude Cleaning Robots\",\"authors\":\"Haiqiao Liu;Lingding Li;Ya Li;Qing Long;Zhuoyu Chen\",\"doi\":\"10.1109/JPHOT.2024.3453943\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Aiming at the problem that cracks with different shapes and scales on the exterior walls of high buildings are difficult to detect, this paper proposed a wall crack detection method for high-altitude cleaning robots by hybridizing the GAM attention mechanism and RepGFPN. First, the GAM attention mechanism was incorporated into the YOLOV5 backbone network to reduce information and amplify global features to improve the accuracy of feature extraction. Then, the neck network incorporated the RepFPN method to improve the descriptive ability of fused multi-scale features and to increase computational efficiency. Public datasets Concrete Crack Images for Classification, Mixed VOC2007, CrackForest-dataset-master, and UCMerced_LandUse were used for experimental validation. The ablation experiment results show that the average accuracy of mAP is improved by 13.5% after introducing the GAM attention mechanism under the yolov5 s original model, while the method in this paper (GR-YOLO) continues to improve by 4.7%. The experimental results show that the average accuracy mAP of the proposed method (GR-YOLO) is 24.0%, 47.1% and 41.0% higher than that of the model yolov5s + involution, yolov5s + p2 + involution and yolov5s + p2 + involution + CBAM, respectively. The method proposed in this article can more effectively improve the accuracy of crack detection and has important application prospects.\",\"PeriodicalId\":13204,\"journal\":{\"name\":\"IEEE Photonics Journal\",\"volume\":\"16 5\",\"pages\":\"1-8\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-09-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10663935\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Photonics Journal\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10663935/\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Photonics Journal","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10663935/","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
A Hybrid Attention Mechanism and RepGFPN Method for Detecting Wall Cracks in High-Altitude Cleaning Robots
Aiming at the problem that cracks with different shapes and scales on the exterior walls of high buildings are difficult to detect, this paper proposed a wall crack detection method for high-altitude cleaning robots by hybridizing the GAM attention mechanism and RepGFPN. First, the GAM attention mechanism was incorporated into the YOLOV5 backbone network to reduce information and amplify global features to improve the accuracy of feature extraction. Then, the neck network incorporated the RepFPN method to improve the descriptive ability of fused multi-scale features and to increase computational efficiency. Public datasets Concrete Crack Images for Classification, Mixed VOC2007, CrackForest-dataset-master, and UCMerced_LandUse were used for experimental validation. The ablation experiment results show that the average accuracy of mAP is improved by 13.5% after introducing the GAM attention mechanism under the yolov5 s original model, while the method in this paper (GR-YOLO) continues to improve by 4.7%. The experimental results show that the average accuracy mAP of the proposed method (GR-YOLO) is 24.0%, 47.1% and 41.0% higher than that of the model yolov5s + involution, yolov5s + p2 + involution and yolov5s + p2 + involution + CBAM, respectively. The method proposed in this article can more effectively improve the accuracy of crack detection and has important application prospects.
期刊介绍:
Breakthroughs in the generation of light and in its control and utilization have given rise to the field of Photonics, a rapidly expanding area of science and technology with major technological and economic impact. Photonics integrates quantum electronics and optics to accelerate progress in the generation of novel photon sources and in their utilization in emerging applications at the micro and nano scales spanning from the far-infrared/THz to the x-ray region of the electromagnetic spectrum. IEEE Photonics Journal is an online-only journal dedicated to the rapid disclosure of top-quality peer-reviewed research at the forefront of all areas of photonics. Contributions addressing issues ranging from fundamental understanding to emerging technologies and applications are within the scope of the Journal. The Journal includes topics in: Photon sources from far infrared to X-rays, Photonics materials and engineered photonic structures, Integrated optics and optoelectronic, Ultrafast, attosecond, high field and short wavelength photonics, Biophotonics, including DNA photonics, Nanophotonics, Magnetophotonics, Fundamentals of light propagation and interaction; nonlinear effects, Optical data storage, Fiber optics and optical communications devices, systems, and technologies, Micro Opto Electro Mechanical Systems (MOEMS), Microwave photonics, Optical Sensors.