{"title":"一个用于火灾原因分类的混合注意框架。","authors":"Heng Peng, Kun Zhu","doi":"10.1371/journal.pone.0333131","DOIUrl":null,"url":null,"abstract":"<p><p>Automated cause classification of fire accident reports (FIREAR) is crucial for enhancing public safety and developing data-driven prevention strategies. However, existing deep learning models often struggle with the unique challenges these documents present-namely their extreme length, high semantic noise, and fragmented causal information. To overcome these limitations, we propose the Fire Accident Reports Attention Mechanism (FAR-AM), a novel hybrid deep learning framework. FAR-AM first uses a large language model (LLM) to preprocess lengthy raw reports into concise, high-signal summaries. Its core architecture then employs an inter-layer self-attention mechanism to dynamically fuse hierarchical features across all encoder layers of BERT. The fused features are subsequently processed by a TextCNN for final classification. We evaluate FAR-AM on AGNews(title), AGNews(content), THUCNews, and our real-world FIREAR corpus. FAR-AM outperforms strong transformer baselines, including RoBERTa. On the FIREAR dataset, it achieves 73.58% accuracy and 70.65% F1. A comprehensive ablation study further validates the contribution of each component in the multi-stage framework. These results indicate that, for complex domain-specific tasks, specialized hybrid architectures can be more effective and robust than monolithic, general-purpose models.</p>","PeriodicalId":20189,"journal":{"name":"PLoS ONE","volume":"20 10","pages":"e0333131"},"PeriodicalIF":2.6000,"publicationDate":"2025-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12510603/pdf/","citationCount":"0","resultStr":"{\"title\":\"FAR-AM: A hybrid attention framework for fire cause classification.\",\"authors\":\"Heng Peng, Kun Zhu\",\"doi\":\"10.1371/journal.pone.0333131\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Automated cause classification of fire accident reports (FIREAR) is crucial for enhancing public safety and developing data-driven prevention strategies. However, existing deep learning models often struggle with the unique challenges these documents present-namely their extreme length, high semantic noise, and fragmented causal information. To overcome these limitations, we propose the Fire Accident Reports Attention Mechanism (FAR-AM), a novel hybrid deep learning framework. FAR-AM first uses a large language model (LLM) to preprocess lengthy raw reports into concise, high-signal summaries. Its core architecture then employs an inter-layer self-attention mechanism to dynamically fuse hierarchical features across all encoder layers of BERT. The fused features are subsequently processed by a TextCNN for final classification. We evaluate FAR-AM on AGNews(title), AGNews(content), THUCNews, and our real-world FIREAR corpus. FAR-AM outperforms strong transformer baselines, including RoBERTa. On the FIREAR dataset, it achieves 73.58% accuracy and 70.65% F1. A comprehensive ablation study further validates the contribution of each component in the multi-stage framework. These results indicate that, for complex domain-specific tasks, specialized hybrid architectures can be more effective and robust than monolithic, general-purpose models.</p>\",\"PeriodicalId\":20189,\"journal\":{\"name\":\"PLoS ONE\",\"volume\":\"20 10\",\"pages\":\"e0333131\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2025-10-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12510603/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"PLoS ONE\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://doi.org/10.1371/journal.pone.0333131\",\"RegionNum\":3,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q1\",\"JCRName\":\"MULTIDISCIPLINARY SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"PLoS ONE","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1371/journal.pone.0333131","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
FAR-AM: A hybrid attention framework for fire cause classification.
Automated cause classification of fire accident reports (FIREAR) is crucial for enhancing public safety and developing data-driven prevention strategies. However, existing deep learning models often struggle with the unique challenges these documents present-namely their extreme length, high semantic noise, and fragmented causal information. To overcome these limitations, we propose the Fire Accident Reports Attention Mechanism (FAR-AM), a novel hybrid deep learning framework. FAR-AM first uses a large language model (LLM) to preprocess lengthy raw reports into concise, high-signal summaries. Its core architecture then employs an inter-layer self-attention mechanism to dynamically fuse hierarchical features across all encoder layers of BERT. The fused features are subsequently processed by a TextCNN for final classification. We evaluate FAR-AM on AGNews(title), AGNews(content), THUCNews, and our real-world FIREAR corpus. FAR-AM outperforms strong transformer baselines, including RoBERTa. On the FIREAR dataset, it achieves 73.58% accuracy and 70.65% F1. A comprehensive ablation study further validates the contribution of each component in the multi-stage framework. These results indicate that, for complex domain-specific tasks, specialized hybrid architectures can be more effective and robust than monolithic, general-purpose models.
期刊介绍:
PLOS ONE is an international, peer-reviewed, open-access, online publication. PLOS ONE welcomes reports on primary research from any scientific discipline. It provides:
* Open-access—freely accessible online, authors retain copyright
* Fast publication times
* Peer review by expert, practicing researchers
* Post-publication tools to indicate quality and impact
* Community-based dialogue on articles
* Worldwide media coverage