基于可见红外图像融合和YOLOv5的矿区地裂缝增强检测

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Yixin Zhao;Liangchen Zhao;Jihong Guo;Kangning Zhang;Chunwei Ling;Shirui Wang;Hua Bian
{"title":"基于可见红外图像融合和YOLOv5的矿区地裂缝增强检测","authors":"Yixin Zhao;Liangchen Zhao;Jihong Guo;Kangning Zhang;Chunwei Ling;Shirui Wang;Hua Bian","doi":"10.1109/JSTARS.2025.3552923","DOIUrl":null,"url":null,"abstract":"Intensive mining operations can lead to the formation of fissures caused by ground subsidence, which present significant threats to building stability, coal mine safety, and the ecological environment. Accurate and timely detection of these fissures is crucial for effective risk management and mitigation. This article proposes FisFusionYOLO, a novel method that integrates visible–infrared image fusion with a YOLOv5 deep learning network to enhance fissure detection accuracy and efficiency. By combining complementary information from visible and infrared images, the fusion strategy improves the representation of fissure features, which are then processed by the YOLOv5 network for precise and efficient object detection. A dataset collected from the Daliuta Mine in the Shendong Mining Area, using a uncrewed aerial vehicle (UAV) equipped with infrared and visible sensors, demonstrates the effectiveness of the FisFusionYOLO. The method achieves a mean average precision (mAP) score of 82.6%, surpassing those trained on visible and infrared image datasets. Furthermore, FisFusionYOLO exhibits superior generalization performance (77.1% mAP), compared to 24.2% for the visible image detector and 24.2% for the infrared image detector. A statistical analysis of fissure distribution and self-healing properties, based on the detection results, provides valuable insights for proactive risk mitigation. This approach offers a robust, automated solution for monitoring ground fissures in mining areas by integrating advanced image fusion techniques with deep learning. The proposed method can contribute to improved safety practices and environmental protection by enabling early detection and systematic assessment of fissure-related hazards.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"18 ","pages":"9033-9053"},"PeriodicalIF":4.7000,"publicationDate":"2025-03-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10933510","citationCount":"0","resultStr":"{\"title\":\"Enhanced Ground Fissure Detection in Mining Areas Based on Visible–Infrared Image Fusion and YOLOv5\",\"authors\":\"Yixin Zhao;Liangchen Zhao;Jihong Guo;Kangning Zhang;Chunwei Ling;Shirui Wang;Hua Bian\",\"doi\":\"10.1109/JSTARS.2025.3552923\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Intensive mining operations can lead to the formation of fissures caused by ground subsidence, which present significant threats to building stability, coal mine safety, and the ecological environment. Accurate and timely detection of these fissures is crucial for effective risk management and mitigation. This article proposes FisFusionYOLO, a novel method that integrates visible–infrared image fusion with a YOLOv5 deep learning network to enhance fissure detection accuracy and efficiency. By combining complementary information from visible and infrared images, the fusion strategy improves the representation of fissure features, which are then processed by the YOLOv5 network for precise and efficient object detection. A dataset collected from the Daliuta Mine in the Shendong Mining Area, using a uncrewed aerial vehicle (UAV) equipped with infrared and visible sensors, demonstrates the effectiveness of the FisFusionYOLO. The method achieves a mean average precision (mAP) score of 82.6%, surpassing those trained on visible and infrared image datasets. Furthermore, FisFusionYOLO exhibits superior generalization performance (77.1% mAP), compared to 24.2% for the visible image detector and 24.2% for the infrared image detector. A statistical analysis of fissure distribution and self-healing properties, based on the detection results, provides valuable insights for proactive risk mitigation. This approach offers a robust, automated solution for monitoring ground fissures in mining areas by integrating advanced image fusion techniques with deep learning. The proposed method can contribute to improved safety practices and environmental protection by enabling early detection and systematic assessment of fissure-related hazards.\",\"PeriodicalId\":13116,\"journal\":{\"name\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"volume\":\"18 \",\"pages\":\"9033-9053\"},\"PeriodicalIF\":4.7000,\"publicationDate\":\"2025-03-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10933510\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10933510/\",\"RegionNum\":2,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10933510/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

密集的采矿作业会导致地表塌陷形成裂隙,对建筑物稳定性、煤矿安全和生态环境构成重大威胁。准确和及时地发现这些裂缝对于有效地管理和减轻风险至关重要。本文提出了一种将可见红外图像融合与YOLOv5深度学习网络相结合的新方法FisFusionYOLO,以提高裂缝检测的精度和效率。通过结合可见光和红外图像的互补信息,该融合策略改善了裂缝特征的表示,然后由YOLOv5网络进行处理,以实现精确高效的目标检测。使用配备红外和可见光传感器的无人驾驶飞行器(UAV)从神东矿区的大柳塔矿收集的数据集证明了FisFusionYOLO的有效性。该方法的平均精度(mAP)得分为82.6%,超过了在可见光和红外图像数据集上训练的方法。此外,FisFusionYOLO具有更好的泛化性能(77.1% mAP),而可见光图像检测器的泛化性能为24.2%,红外图像检测器的泛化性能为24.2%。基于检测结果对裂缝分布和自愈特性进行统计分析,为主动降低风险提供了有价值的见解。该方法通过将先进的图像融合技术与深度学习相结合,为监测矿区地裂缝提供了一种强大的自动化解决方案。所提出的方法可以通过早期发现和系统评估裂缝相关危害,有助于改善安全实践和环境保护。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Enhanced Ground Fissure Detection in Mining Areas Based on Visible–Infrared Image Fusion and YOLOv5
Intensive mining operations can lead to the formation of fissures caused by ground subsidence, which present significant threats to building stability, coal mine safety, and the ecological environment. Accurate and timely detection of these fissures is crucial for effective risk management and mitigation. This article proposes FisFusionYOLO, a novel method that integrates visible–infrared image fusion with a YOLOv5 deep learning network to enhance fissure detection accuracy and efficiency. By combining complementary information from visible and infrared images, the fusion strategy improves the representation of fissure features, which are then processed by the YOLOv5 network for precise and efficient object detection. A dataset collected from the Daliuta Mine in the Shendong Mining Area, using a uncrewed aerial vehicle (UAV) equipped with infrared and visible sensors, demonstrates the effectiveness of the FisFusionYOLO. The method achieves a mean average precision (mAP) score of 82.6%, surpassing those trained on visible and infrared image datasets. Furthermore, FisFusionYOLO exhibits superior generalization performance (77.1% mAP), compared to 24.2% for the visible image detector and 24.2% for the infrared image detector. A statistical analysis of fissure distribution and self-healing properties, based on the detection results, provides valuable insights for proactive risk mitigation. This approach offers a robust, automated solution for monitoring ground fissures in mining areas by integrating advanced image fusion techniques with deep learning. The proposed method can contribute to improved safety practices and environmental protection by enabling early detection and systematic assessment of fissure-related hazards.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信