Caiwei Liu , Libin Tian , Pengfei Wang , Qian-Qian Yu , Xiangyi Zhong , Jijun Miao
{"title":"基于深度学习和多模态感知的火灾钢筋混凝土结构的知识驱动三维损伤映射和决策支持","authors":"Caiwei Liu , Libin Tian , Pengfei Wang , Qian-Qian Yu , Xiangyi Zhong , Jijun Miao","doi":"10.1016/j.aei.2025.103715","DOIUrl":null,"url":null,"abstract":"<div><div>Rapid and precise damage assessment of fire-damaged reinforced concrete (RC) structures is critical for structural safety decisions. To overcome limitations of existing 2D methods in spatial localization and real-time deployment, an integrated knowledge-driven framework is proposed. Multi-modal sensing is combined with an enhanced FastSAM-P deep learning network for automated 3D damage mapping. Three core innovations are introduced: (1) Deformable Spatial-Channel Reconstruction Convolution (DSCConv) dynamically adjusts receptive fields to capture fine-grained damage features; (2) Receptive Field Block (RFB) module optimizes multi-scale feature extraction; (3) Pyramid Pooling Shuffle Attention (PPSM) enhances robustness in noisy environments through contextual fusion. The framework achieves 92.0 % mean Intersection-over-Union (mIoU) for segmenting concrete spalling and rebar exposure, with inference at 65.11 FPS on GPU. Validation across five public datasets (roads, bridges, buildings) confirms generalization capability. Deployment on Jetson TX1 edge devices demonstrates operational feasibility (123.4 ms latency). Integration with photogrammetric 3D reconstruction enables damage localization within ± 15 mm accuracy. This approach establishes a scientifically rigorous pipeline from data acquisition to decision support, significantly advancing automated post-fire assessment for knowledge-intensive engineering tasks.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"68 ","pages":"Article 103715"},"PeriodicalIF":9.9000,"publicationDate":"2025-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Knowledge-driven 3D damage mapping and decision support for fire-damaged reinforced concrete structures using enhanced deep learning and multi-modal sensing\",\"authors\":\"Caiwei Liu , Libin Tian , Pengfei Wang , Qian-Qian Yu , Xiangyi Zhong , Jijun Miao\",\"doi\":\"10.1016/j.aei.2025.103715\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Rapid and precise damage assessment of fire-damaged reinforced concrete (RC) structures is critical for structural safety decisions. To overcome limitations of existing 2D methods in spatial localization and real-time deployment, an integrated knowledge-driven framework is proposed. Multi-modal sensing is combined with an enhanced FastSAM-P deep learning network for automated 3D damage mapping. Three core innovations are introduced: (1) Deformable Spatial-Channel Reconstruction Convolution (DSCConv) dynamically adjusts receptive fields to capture fine-grained damage features; (2) Receptive Field Block (RFB) module optimizes multi-scale feature extraction; (3) Pyramid Pooling Shuffle Attention (PPSM) enhances robustness in noisy environments through contextual fusion. The framework achieves 92.0 % mean Intersection-over-Union (mIoU) for segmenting concrete spalling and rebar exposure, with inference at 65.11 FPS on GPU. Validation across five public datasets (roads, bridges, buildings) confirms generalization capability. Deployment on Jetson TX1 edge devices demonstrates operational feasibility (123.4 ms latency). Integration with photogrammetric 3D reconstruction enables damage localization within ± 15 mm accuracy. This approach establishes a scientifically rigorous pipeline from data acquisition to decision support, significantly advancing automated post-fire assessment for knowledge-intensive engineering tasks.</div></div>\",\"PeriodicalId\":50941,\"journal\":{\"name\":\"Advanced Engineering Informatics\",\"volume\":\"68 \",\"pages\":\"Article 103715\"},\"PeriodicalIF\":9.9000,\"publicationDate\":\"2025-07-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced Engineering Informatics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1474034625006081\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034625006081","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Knowledge-driven 3D damage mapping and decision support for fire-damaged reinforced concrete structures using enhanced deep learning and multi-modal sensing
Rapid and precise damage assessment of fire-damaged reinforced concrete (RC) structures is critical for structural safety decisions. To overcome limitations of existing 2D methods in spatial localization and real-time deployment, an integrated knowledge-driven framework is proposed. Multi-modal sensing is combined with an enhanced FastSAM-P deep learning network for automated 3D damage mapping. Three core innovations are introduced: (1) Deformable Spatial-Channel Reconstruction Convolution (DSCConv) dynamically adjusts receptive fields to capture fine-grained damage features; (2) Receptive Field Block (RFB) module optimizes multi-scale feature extraction; (3) Pyramid Pooling Shuffle Attention (PPSM) enhances robustness in noisy environments through contextual fusion. The framework achieves 92.0 % mean Intersection-over-Union (mIoU) for segmenting concrete spalling and rebar exposure, with inference at 65.11 FPS on GPU. Validation across five public datasets (roads, bridges, buildings) confirms generalization capability. Deployment on Jetson TX1 edge devices demonstrates operational feasibility (123.4 ms latency). Integration with photogrammetric 3D reconstruction enables damage localization within ± 15 mm accuracy. This approach establishes a scientifically rigorous pipeline from data acquisition to decision support, significantly advancing automated post-fire assessment for knowledge-intensive engineering tasks.
期刊介绍:
Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.