Using Multimodal Large Language Models for False Alarm Reduction in Image-Based Fire Detection

IF 2.4 3区 工程技术 Q2 ENGINEERING, MULTIDISCIPLINARY
Qie Gao, Haihui Wang, Zhenhai Qin, Linhao Fan, Kang Li, Chong Wang, Qixing Zhang
{"title":"Using Multimodal Large Language Models for False Alarm Reduction in Image-Based Fire Detection","authors":"Qie Gao,&nbsp;Haihui Wang,&nbsp;Zhenhai Qin,&nbsp;Linhao Fan,&nbsp;Kang Li,&nbsp;Chong Wang,&nbsp;Qixing Zhang","doi":"10.1007/s10694-026-02000-3","DOIUrl":null,"url":null,"abstract":"<div><p>Existing vision-based methods suffer from high false alarm rates in urban flame detection. Applying Multimodal Large Language Models (MLLMs) for secondary filtering shows great potential for reducing false alarms, yet they have high inference latency and are prone to reasoning collapse on negative samples without explicit Chain-of-Thought (CoT) guidance. To overcome these challenges, this study proposes Flash-Cascade, the first sub-second MLLM-based firewall that leverages CoT for efficiently filtering false alarms. We deconstructed the flame detection process into four logical stages (planning, observation, analysis, and judgment), which informed the design of three switchable reasoning modes (Detailed, Quick, and Rapid) to achieve inference acceleration via CoT compression. We fine-tuned Qwen2-VL-7B-Instruct on a multi-granularity instruction dataset via Low-Rank Adaptation. This process decoupled the model’s discriminative capability from long-form text generation, thereby enabling robust performance even without explicit CoT guidance. On our newly constructed benchmark incorporating real-world hard negatives, Flash-Cascade achieves an accuracy of 97.79% and an F1-score of 0.977 in Rapid mode, outperforming the zero-shot baseline by 61.63 percentage points (pp) and 0.515, respectively. Furthermore, it outperforms the state-of-the-art object detector DEIMv2 by 14.64 pp in accuracy. The method exhibits exceptional sample efficiency, converging with only 600 samples and 2 epochs, and improves inference speed by 810% over standard CoT. This study opens new avenues for robust and efficient flame detection in high-interference scenarios.</p></div>","PeriodicalId":558,"journal":{"name":"Fire Technology","volume":"62 6","pages":""},"PeriodicalIF":2.4000,"publicationDate":"2026-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Fire Technology","FirstCategoryId":"5","ListUrlMain":"https://link.springer.com/article/10.1007/s10694-026-02000-3","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

Existing vision-based methods suffer from high false alarm rates in urban flame detection. Applying Multimodal Large Language Models (MLLMs) for secondary filtering shows great potential for reducing false alarms, yet they have high inference latency and are prone to reasoning collapse on negative samples without explicit Chain-of-Thought (CoT) guidance. To overcome these challenges, this study proposes Flash-Cascade, the first sub-second MLLM-based firewall that leverages CoT for efficiently filtering false alarms. We deconstructed the flame detection process into four logical stages (planning, observation, analysis, and judgment), which informed the design of three switchable reasoning modes (Detailed, Quick, and Rapid) to achieve inference acceleration via CoT compression. We fine-tuned Qwen2-VL-7B-Instruct on a multi-granularity instruction dataset via Low-Rank Adaptation. This process decoupled the model’s discriminative capability from long-form text generation, thereby enabling robust performance even without explicit CoT guidance. On our newly constructed benchmark incorporating real-world hard negatives, Flash-Cascade achieves an accuracy of 97.79% and an F1-score of 0.977 in Rapid mode, outperforming the zero-shot baseline by 61.63 percentage points (pp) and 0.515, respectively. Furthermore, it outperforms the state-of-the-art object detector DEIMv2 by 14.64 pp in accuracy. The method exhibits exceptional sample efficiency, converging with only 600 samples and 2 epochs, and improves inference speed by 810% over standard CoT. This study opens new avenues for robust and efficient flame detection in high-interference scenarios.

基于图像的火灾检测中使用多模态大语言模型减少误报
现有的基于视觉的城市火焰检测方法存在虚警率高的问题。应用多模态大语言模型(Multimodal Large Language Models, MLLMs)进行二次滤波显示出减少误报的巨大潜力,但它们具有很高的推理延迟,并且在没有明确的思维链(chain of thought, CoT)指导的情况下容易在负样本上推理崩溃。为了克服这些挑战,本研究提出了Flash-Cascade,这是第一个基于亚秒mllm的防火墙,它利用CoT有效地过滤假警报。我们将火焰检测过程分解为四个逻辑阶段(规划、观察、分析和判断),并据此设计了三种可切换的推理模式(Detailed、Quick和Rapid),通过CoT压缩实现推理加速。我们通过低秩自适应对多粒度指令数据集qwen2 - vl - 7b - instruction进行了微调。该过程将模型的判别能力与长格式文本生成解耦,从而即使没有明确的CoT指导也能实现健壮的性能。在我们新构建的包含真实世界硬底片的基准上,Flash-Cascade在快速模式下的准确率为97.79%,f1得分为0.977,分别比零拍摄基线高61.63个百分点和0.515个百分点。此外,它比最先进的目标探测器DEIMv2的精度高出14.64 pp。该方法具有优异的样本效率,仅用600个样本和2个epoch就能收敛,推理速度比标准CoT提高了810%。本研究为高干扰情况下的鲁棒和高效火焰检测开辟了新的途径。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Fire Technology
Fire Technology 工程技术-材料科学:综合
CiteScore
6.60
自引率
14.70%
发文量
137
审稿时长
7.5 months
期刊介绍: Fire Technology publishes original contributions, both theoretical and empirical, that contribute to the solution of problems in fire safety science and engineering. It is the leading journal in the field, publishing applied research dealing with the full range of actual and potential fire hazards facing humans and the environment. It covers the entire domain of fire safety science and engineering problems relevant in industrial, operational, cultural, and environmental applications, including modeling, testing, detection, suppression, human behavior, wildfires, structures, and risk analysis. The aim of Fire Technology is to push forward the frontiers of knowledge and technology by encouraging interdisciplinary communication of significant technical developments in fire protection and subjects of scientific interest to the fire protection community at large. It is published in conjunction with the National Fire Protection Association (NFPA) and the Society of Fire Protection Engineers (SFPE). The mission of NFPA is to help save lives and reduce loss with information, knowledge, and passion. The mission of SFPE is advancing the science and practice of fire protection engineering internationally.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书