FF-fusion:一种用于森林火灾监测的知识提炼的轻型可见-红外图像融合框架

IF 8.5 2区 环境科学与生态学 Q1 ECOLOGY
Ecological Informatics Pub Date : 2026-08-01 Epub Date: 2026-07-25 DOI:10.1016/j.ecoinf.2026.103952
Qian Yu, Gui Zhang, Ying Wang, Xin Wu, Wenping Liu, Zhuo Ouyang, Zhi Jiang, Long Qi, Wuyang Hu
{"title":"FF-fusion:一种用于森林火灾监测的知识提炼的轻型可见-红外图像融合框架","authors":"Qian Yu,&nbsp;Gui Zhang,&nbsp;Ying Wang,&nbsp;Xin Wu,&nbsp;Wenping Liu,&nbsp;Zhuo Ouyang,&nbsp;Zhi Jiang,&nbsp;Long Qi,&nbsp;Wuyang Hu","doi":"10.1016/j.ecoinf.2026.103952","DOIUrl":null,"url":null,"abstract":"<div><div>Visible–infrared image fusion offers an effective strategy for forest fire monitoring by integrating complementary information from visible-light and thermal-infrared modalities, particularly under smoke interference, low illumination, and complex forest backgrounds. However, forest-fire-specific paired datasets remain scarce, and lightweight fusion methods have seldom been evaluated under real-world monitoring scenarios and edge-deployment constraints. To address these limitations, this study constructs TF-1770, a spatially aligned visible–infrared forest fire dataset collected from ground-based and UAV-based firefighting scenes. The dataset comprises paired visible-light and thermal-infrared images captured under diverse viewpoints, smoke densities, illumination conditions, and target scales. Based on TF-1770, we propose FF-Fusion, a lightweight visible–infrared image fusion framework based on knowledge distillation. The teacher network learns robust multimodal representations through wavelet-based fusion and cross-modal feature modeling, while the student network incorporates re-parameterizable convolution blocks to enable efficient edge inference. Experimental results on TF-1770 show that FF-Fusion achieves entropy, standard deviation, average gradient, visual information fidelity, and edge information transfer metric values of 7.10, 43.66, 10.83, 0.649, and 0.584, respectively. The deployable student model maintains a compact size of only 1.34 MB. Downstream detection experiments demonstrate that the fused images enhance the perception of flames, smoke, and firefighters. Moreover, edge-deployment tests on heterogeneous platforms verify the feasibility of FF-Fusion for resource-constrained devices. These results indicate that lightweight visible–infrared image fusion can provide effective visual support for practical forest fire monitoring. The proposed workflow, spanning dataset construction, model design, downstream validation, and edge deployment, may also serve as a reference for future deployable ecological monitoring systems.</div></div>","PeriodicalId":51024,"journal":{"name":"Ecological Informatics","volume":"97 ","pages":"Article 103952"},"PeriodicalIF":8.5000,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"FF-fusion: A knowledge-distilled lightweight visible–infrared image fusion framework for Forest fire monitoring\",\"authors\":\"Qian Yu,&nbsp;Gui Zhang,&nbsp;Ying Wang,&nbsp;Xin Wu,&nbsp;Wenping Liu,&nbsp;Zhuo Ouyang,&nbsp;Zhi Jiang,&nbsp;Long Qi,&nbsp;Wuyang Hu\",\"doi\":\"10.1016/j.ecoinf.2026.103952\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Visible–infrared image fusion offers an effective strategy for forest fire monitoring by integrating complementary information from visible-light and thermal-infrared modalities, particularly under smoke interference, low illumination, and complex forest backgrounds. However, forest-fire-specific paired datasets remain scarce, and lightweight fusion methods have seldom been evaluated under real-world monitoring scenarios and edge-deployment constraints. To address these limitations, this study constructs TF-1770, a spatially aligned visible–infrared forest fire dataset collected from ground-based and UAV-based firefighting scenes. The dataset comprises paired visible-light and thermal-infrared images captured under diverse viewpoints, smoke densities, illumination conditions, and target scales. Based on TF-1770, we propose FF-Fusion, a lightweight visible–infrared image fusion framework based on knowledge distillation. The teacher network learns robust multimodal representations through wavelet-based fusion and cross-modal feature modeling, while the student network incorporates re-parameterizable convolution blocks to enable efficient edge inference. Experimental results on TF-1770 show that FF-Fusion achieves entropy, standard deviation, average gradient, visual information fidelity, and edge information transfer metric values of 7.10, 43.66, 10.83, 0.649, and 0.584, respectively. The deployable student model maintains a compact size of only 1.34 MB. Downstream detection experiments demonstrate that the fused images enhance the perception of flames, smoke, and firefighters. Moreover, edge-deployment tests on heterogeneous platforms verify the feasibility of FF-Fusion for resource-constrained devices. These results indicate that lightweight visible–infrared image fusion can provide effective visual support for practical forest fire monitoring. The proposed workflow, spanning dataset construction, model design, downstream validation, and edge deployment, may also serve as a reference for future deployable ecological monitoring systems.</div></div>\",\"PeriodicalId\":51024,\"journal\":{\"name\":\"Ecological Informatics\",\"volume\":\"97 \",\"pages\":\"Article 103952\"},\"PeriodicalIF\":8.5000,\"publicationDate\":\"2026-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ecological Informatics\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1574954126003596\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2026/7/25 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"ECOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Informatics","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1574954126003596","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/7/25 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

可见光与红外图像融合是一种有效的森林火灾监测策略,特别是在烟雾干扰、低照度和复杂森林背景下,它可以整合可见光和热红外模式的互补信息。然而,森林火灾特定的配对数据集仍然稀缺,轻量级融合方法很少在实际监测场景和边缘部署约束下进行评估。为了解决这些局限性,本研究构建了TF-1770,这是一个从地面和无人机消防场景中收集的空间对齐的可见-红外森林火灾数据集。该数据集包括在不同视点、烟雾密度、照明条件和目标尺度下拍摄的成对可见光和热红外图像。基于TF-1770,提出了一种基于知识蒸馏的轻量化可见红外图像融合框架FF-Fusion。教师网络通过基于小波的融合和跨模态特征建模来学习鲁棒的多模态表示,而学生网络则采用可重新参数化的卷积块来实现有效的边缘推理。在TF-1770上的实验结果表明,FF-Fusion的熵值、标准差、平均梯度、视觉信息保真度和边缘信息传递度量值分别为7.10、43.66、10.83、0.649和0.584。可部署的学生模型保持了仅1.34 MB的紧凑尺寸。下游检测实验表明,融合的图像增强了对火焰、烟雾和消防员的感知。此外,在异构平台上的边缘部署测试验证了FF-Fusion在资源受限设备上的可行性。结果表明,轻量化的可见红外图像融合可以为实际森林火灾监测提供有效的视觉支持。提出的工作流程、跨数据集构建、模型设计、下游验证和边缘部署,也可以作为未来可部署生态监测系统的参考。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
FF-fusion: A knowledge-distilled lightweight visible–infrared image fusion framework for Forest fire monitoring
Visible–infrared image fusion offers an effective strategy for forest fire monitoring by integrating complementary information from visible-light and thermal-infrared modalities, particularly under smoke interference, low illumination, and complex forest backgrounds. However, forest-fire-specific paired datasets remain scarce, and lightweight fusion methods have seldom been evaluated under real-world monitoring scenarios and edge-deployment constraints. To address these limitations, this study constructs TF-1770, a spatially aligned visible–infrared forest fire dataset collected from ground-based and UAV-based firefighting scenes. The dataset comprises paired visible-light and thermal-infrared images captured under diverse viewpoints, smoke densities, illumination conditions, and target scales. Based on TF-1770, we propose FF-Fusion, a lightweight visible–infrared image fusion framework based on knowledge distillation. The teacher network learns robust multimodal representations through wavelet-based fusion and cross-modal feature modeling, while the student network incorporates re-parameterizable convolution blocks to enable efficient edge inference. Experimental results on TF-1770 show that FF-Fusion achieves entropy, standard deviation, average gradient, visual information fidelity, and edge information transfer metric values of 7.10, 43.66, 10.83, 0.649, and 0.584, respectively. The deployable student model maintains a compact size of only 1.34 MB. Downstream detection experiments demonstrate that the fused images enhance the perception of flames, smoke, and firefighters. Moreover, edge-deployment tests on heterogeneous platforms verify the feasibility of FF-Fusion for resource-constrained devices. These results indicate that lightweight visible–infrared image fusion can provide effective visual support for practical forest fire monitoring. The proposed workflow, spanning dataset construction, model design, downstream validation, and edge deployment, may also serve as a reference for future deployable ecological monitoring systems.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Ecological Informatics
Ecological Informatics 环境科学-生态学
CiteScore
8.30
自引率
11.80%
发文量
346
审稿时长
46 days
期刊介绍: The journal Ecological Informatics is devoted to the publication of high quality, peer-reviewed articles on all aspects of computational ecology, data science and biogeography. The scope of the journal takes into account the data-intensive nature of ecology, the growing capacity of information technology to access, harness and leverage complex data as well as the critical need for informing sustainable management in view of global environmental and climate change. The nature of the journal is interdisciplinary at the crossover between ecology and informatics. It focuses on novel concepts and techniques for image- and genome-based monitoring and interpretation, sensor- and multimedia-based data acquisition, internet-based data archiving and sharing, data assimilation, modelling and prediction of ecological data.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书