{"title":"基于可见红外图像融合和YOLOv5的矿区地裂缝增强检测","authors":"Yixin Zhao;Liangchen Zhao;Jihong Guo;Kangning Zhang;Chunwei Ling;Shirui Wang;Hua Bian","doi":"10.1109/JSTARS.2025.3552923","DOIUrl":null,"url":null,"abstract":"Intensive mining operations can lead to the formation of fissures caused by ground subsidence, which present significant threats to building stability, coal mine safety, and the ecological environment. Accurate and timely detection of these fissures is crucial for effective risk management and mitigation. This article proposes FisFusionYOLO, a novel method that integrates visible–infrared image fusion with a YOLOv5 deep learning network to enhance fissure detection accuracy and efficiency. By combining complementary information from visible and infrared images, the fusion strategy improves the representation of fissure features, which are then processed by the YOLOv5 network for precise and efficient object detection. A dataset collected from the Daliuta Mine in the Shendong Mining Area, using a uncrewed aerial vehicle (UAV) equipped with infrared and visible sensors, demonstrates the effectiveness of the FisFusionYOLO. The method achieves a mean average precision (mAP) score of 82.6%, surpassing those trained on visible and infrared image datasets. Furthermore, FisFusionYOLO exhibits superior generalization performance (77.1% mAP), compared to 24.2% for the visible image detector and 24.2% for the infrared image detector. A statistical analysis of fissure distribution and self-healing properties, based on the detection results, provides valuable insights for proactive risk mitigation. This approach offers a robust, automated solution for monitoring ground fissures in mining areas by integrating advanced image fusion techniques with deep learning. The proposed method can contribute to improved safety practices and environmental protection by enabling early detection and systematic assessment of fissure-related hazards.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"18 ","pages":"9033-9053"},"PeriodicalIF":4.7000,"publicationDate":"2025-03-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10933510","citationCount":"0","resultStr":"{\"title\":\"Enhanced Ground Fissure Detection in Mining Areas Based on Visible–Infrared Image Fusion and YOLOv5\",\"authors\":\"Yixin Zhao;Liangchen Zhao;Jihong Guo;Kangning Zhang;Chunwei Ling;Shirui Wang;Hua Bian\",\"doi\":\"10.1109/JSTARS.2025.3552923\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Intensive mining operations can lead to the formation of fissures caused by ground subsidence, which present significant threats to building stability, coal mine safety, and the ecological environment. Accurate and timely detection of these fissures is crucial for effective risk management and mitigation. This article proposes FisFusionYOLO, a novel method that integrates visible–infrared image fusion with a YOLOv5 deep learning network to enhance fissure detection accuracy and efficiency. By combining complementary information from visible and infrared images, the fusion strategy improves the representation of fissure features, which are then processed by the YOLOv5 network for precise and efficient object detection. A dataset collected from the Daliuta Mine in the Shendong Mining Area, using a uncrewed aerial vehicle (UAV) equipped with infrared and visible sensors, demonstrates the effectiveness of the FisFusionYOLO. The method achieves a mean average precision (mAP) score of 82.6%, surpassing those trained on visible and infrared image datasets. Furthermore, FisFusionYOLO exhibits superior generalization performance (77.1% mAP), compared to 24.2% for the visible image detector and 24.2% for the infrared image detector. A statistical analysis of fissure distribution and self-healing properties, based on the detection results, provides valuable insights for proactive risk mitigation. This approach offers a robust, automated solution for monitoring ground fissures in mining areas by integrating advanced image fusion techniques with deep learning. The proposed method can contribute to improved safety practices and environmental protection by enabling early detection and systematic assessment of fissure-related hazards.\",\"PeriodicalId\":13116,\"journal\":{\"name\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"volume\":\"18 \",\"pages\":\"9033-9053\"},\"PeriodicalIF\":4.7000,\"publicationDate\":\"2025-03-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10933510\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10933510/\",\"RegionNum\":2,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10933510/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Enhanced Ground Fissure Detection in Mining Areas Based on Visible–Infrared Image Fusion and YOLOv5
Intensive mining operations can lead to the formation of fissures caused by ground subsidence, which present significant threats to building stability, coal mine safety, and the ecological environment. Accurate and timely detection of these fissures is crucial for effective risk management and mitigation. This article proposes FisFusionYOLO, a novel method that integrates visible–infrared image fusion with a YOLOv5 deep learning network to enhance fissure detection accuracy and efficiency. By combining complementary information from visible and infrared images, the fusion strategy improves the representation of fissure features, which are then processed by the YOLOv5 network for precise and efficient object detection. A dataset collected from the Daliuta Mine in the Shendong Mining Area, using a uncrewed aerial vehicle (UAV) equipped with infrared and visible sensors, demonstrates the effectiveness of the FisFusionYOLO. The method achieves a mean average precision (mAP) score of 82.6%, surpassing those trained on visible and infrared image datasets. Furthermore, FisFusionYOLO exhibits superior generalization performance (77.1% mAP), compared to 24.2% for the visible image detector and 24.2% for the infrared image detector. A statistical analysis of fissure distribution and self-healing properties, based on the detection results, provides valuable insights for proactive risk mitigation. This approach offers a robust, automated solution for monitoring ground fissures in mining areas by integrating advanced image fusion techniques with deep learning. The proposed method can contribute to improved safety practices and environmental protection by enabling early detection and systematic assessment of fissure-related hazards.
期刊介绍:
The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.