Qian Yu, Gui Zhang, Ying Wang, Xin Wu, Wenping Liu, Zhuo Ouyang, Zhi Jiang, Long Qi, Wuyang Hu
{"title":"FF-fusion: A knowledge-distilled lightweight visible–infrared image fusion framework for Forest fire monitoring","authors":"Qian Yu, Gui Zhang, Ying Wang, Xin Wu, Wenping Liu, Zhuo Ouyang, Zhi Jiang, Long Qi, Wuyang Hu","doi":"10.1016/j.ecoinf.2026.103952","DOIUrl":null,"url":null,"abstract":"<div><div>Visible–infrared image fusion offers an effective strategy for forest fire monitoring by integrating complementary information from visible-light and thermal-infrared modalities, particularly under smoke interference, low illumination, and complex forest backgrounds. However, forest-fire-specific paired datasets remain scarce, and lightweight fusion methods have seldom been evaluated under real-world monitoring scenarios and edge-deployment constraints. To address these limitations, this study constructs TF-1770, a spatially aligned visible–infrared forest fire dataset collected from ground-based and UAV-based firefighting scenes. The dataset comprises paired visible-light and thermal-infrared images captured under diverse viewpoints, smoke densities, illumination conditions, and target scales. Based on TF-1770, we propose FF-Fusion, a lightweight visible–infrared image fusion framework based on knowledge distillation. The teacher network learns robust multimodal representations through wavelet-based fusion and cross-modal feature modeling, while the student network incorporates re-parameterizable convolution blocks to enable efficient edge inference. Experimental results on TF-1770 show that FF-Fusion achieves entropy, standard deviation, average gradient, visual information fidelity, and edge information transfer metric values of 7.10, 43.66, 10.83, 0.649, and 0.584, respectively. The deployable student model maintains a compact size of only 1.34 MB. Downstream detection experiments demonstrate that the fused images enhance the perception of flames, smoke, and firefighters. Moreover, edge-deployment tests on heterogeneous platforms verify the feasibility of FF-Fusion for resource-constrained devices. These results indicate that lightweight visible–infrared image fusion can provide effective visual support for practical forest fire monitoring. The proposed workflow, spanning dataset construction, model design, downstream validation, and edge deployment, may also serve as a reference for future deployable ecological monitoring systems.</div></div>","PeriodicalId":51024,"journal":{"name":"Ecological Informatics","volume":"97 ","pages":"Article 103952"},"PeriodicalIF":8.5000,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Informatics","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1574954126003596","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/7/25 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Visible–infrared image fusion offers an effective strategy for forest fire monitoring by integrating complementary information from visible-light and thermal-infrared modalities, particularly under smoke interference, low illumination, and complex forest backgrounds. However, forest-fire-specific paired datasets remain scarce, and lightweight fusion methods have seldom been evaluated under real-world monitoring scenarios and edge-deployment constraints. To address these limitations, this study constructs TF-1770, a spatially aligned visible–infrared forest fire dataset collected from ground-based and UAV-based firefighting scenes. The dataset comprises paired visible-light and thermal-infrared images captured under diverse viewpoints, smoke densities, illumination conditions, and target scales. Based on TF-1770, we propose FF-Fusion, a lightweight visible–infrared image fusion framework based on knowledge distillation. The teacher network learns robust multimodal representations through wavelet-based fusion and cross-modal feature modeling, while the student network incorporates re-parameterizable convolution blocks to enable efficient edge inference. Experimental results on TF-1770 show that FF-Fusion achieves entropy, standard deviation, average gradient, visual information fidelity, and edge information transfer metric values of 7.10, 43.66, 10.83, 0.649, and 0.584, respectively. The deployable student model maintains a compact size of only 1.34 MB. Downstream detection experiments demonstrate that the fused images enhance the perception of flames, smoke, and firefighters. Moreover, edge-deployment tests on heterogeneous platforms verify the feasibility of FF-Fusion for resource-constrained devices. These results indicate that lightweight visible–infrared image fusion can provide effective visual support for practical forest fire monitoring. The proposed workflow, spanning dataset construction, model design, downstream validation, and edge deployment, may also serve as a reference for future deployable ecological monitoring systems.
期刊介绍:
The journal Ecological Informatics is devoted to the publication of high quality, peer-reviewed articles on all aspects of computational ecology, data science and biogeography. The scope of the journal takes into account the data-intensive nature of ecology, the growing capacity of information technology to access, harness and leverage complex data as well as the critical need for informing sustainable management in view of global environmental and climate change.
The nature of the journal is interdisciplinary at the crossover between ecology and informatics. It focuses on novel concepts and techniques for image- and genome-based monitoring and interpretation, sensor- and multimedia-based data acquisition, internet-based data archiving and sharing, data assimilation, modelling and prediction of ecological data.