{"title":"Bi-DAUnet:在类 Unet 架构中利用 BiFormer 进行建筑物损坏评估","authors":"Chao Dong, Xi Zhao","doi":"10.1088/1742-6596/2833/1/012015","DOIUrl":null,"url":null,"abstract":"In recent years, Convolutional Neural Networks (CNNs) have become an important research direction in the field of building damage assessment. Particularly, deep neural networks based on the U-shaped architecture and skip connections have achieved significant breakthroughs in the task of architectural damage assessment. Despite the impressive performance of CNNs, effectively capturing global and long-range semantic information remains a challenge due to the local nature of their convolutional operations. To address this issue, we propose a novel architectural damage assessment model called Bi-DAUnet, which adopts a BiFormer structure similar to U-Net. In this model, we employ a U-shaped encoder-decoder architecture based on BiFormer and combine it with skip connections to achieve global semantic feature learning. Specifically, we utilize a hierarchical BiFormer with a dual-layer routing attention mechanism as the encoder to extract contextual features of architectural images. In the symmetric decoder, a BiFormer Block is introduced to fuse shallow and deep features of the feature maps and learn the correlation between pixels at distant locations. Experimental results indicate that the U-shaped encoder-decoder network based on BiFormer achieves superior performance in the task of architectural damage assessment compared to fully convolutional methods.","PeriodicalId":16821,"journal":{"name":"Journal of Physics: Conference Series","volume":"5 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Bi-DAUnet: Leveraging BiFormer in a Unet-like Architecture for Building Damage Assessment\",\"authors\":\"Chao Dong, Xi Zhao\",\"doi\":\"10.1088/1742-6596/2833/1/012015\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In recent years, Convolutional Neural Networks (CNNs) have become an important research direction in the field of building damage assessment. Particularly, deep neural networks based on the U-shaped architecture and skip connections have achieved significant breakthroughs in the task of architectural damage assessment. Despite the impressive performance of CNNs, effectively capturing global and long-range semantic information remains a challenge due to the local nature of their convolutional operations. To address this issue, we propose a novel architectural damage assessment model called Bi-DAUnet, which adopts a BiFormer structure similar to U-Net. In this model, we employ a U-shaped encoder-decoder architecture based on BiFormer and combine it with skip connections to achieve global semantic feature learning. Specifically, we utilize a hierarchical BiFormer with a dual-layer routing attention mechanism as the encoder to extract contextual features of architectural images. In the symmetric decoder, a BiFormer Block is introduced to fuse shallow and deep features of the feature maps and learn the correlation between pixels at distant locations. Experimental results indicate that the U-shaped encoder-decoder network based on BiFormer achieves superior performance in the task of architectural damage assessment compared to fully convolutional methods.\",\"PeriodicalId\":16821,\"journal\":{\"name\":\"Journal of Physics: Conference Series\",\"volume\":\"5 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Physics: Conference Series\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1088/1742-6596/2833/1/012015\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Physics: Conference Series","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1088/1742-6596/2833/1/012015","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
近年来,卷积神经网络(CNN)已成为建筑损伤评估领域的一个重要研究方向。特别是基于 U 型架构和跳接的深度神经网络在建筑损伤评估任务中取得了重大突破。尽管 CNN 的性能令人印象深刻,但由于其卷积操作的局部性,有效捕捉全局和长距离语义信息仍然是一个挑战。为了解决这个问题,我们提出了一种名为 Bi-DAUnet 的新型建筑损坏评估模型,它采用了类似于 U-Net 的 BiFormer 结构。在该模型中,我们采用了基于 BiFormer 的 U 型编码器-解码器架构,并将其与跳转连接相结合,以实现全局语义特征学习。具体来说,我们利用具有双层路由注意机制的分层 BiFormer 作为编码器,提取建筑图像的上下文特征。在对称解码器中,引入 BiFormer Block 来融合特征图的浅层和深层特征,并学习远处像素之间的相关性。实验结果表明,与全卷积方法相比,基于 BiFormer 的 U 型编码器-解码器网络在建筑损坏评估任务中取得了更优越的性能。
Bi-DAUnet: Leveraging BiFormer in a Unet-like Architecture for Building Damage Assessment
In recent years, Convolutional Neural Networks (CNNs) have become an important research direction in the field of building damage assessment. Particularly, deep neural networks based on the U-shaped architecture and skip connections have achieved significant breakthroughs in the task of architectural damage assessment. Despite the impressive performance of CNNs, effectively capturing global and long-range semantic information remains a challenge due to the local nature of their convolutional operations. To address this issue, we propose a novel architectural damage assessment model called Bi-DAUnet, which adopts a BiFormer structure similar to U-Net. In this model, we employ a U-shaped encoder-decoder architecture based on BiFormer and combine it with skip connections to achieve global semantic feature learning. Specifically, we utilize a hierarchical BiFormer with a dual-layer routing attention mechanism as the encoder to extract contextual features of architectural images. In the symmetric decoder, a BiFormer Block is introduced to fuse shallow and deep features of the feature maps and learn the correlation between pixels at distant locations. Experimental results indicate that the U-shaped encoder-decoder network based on BiFormer achieves superior performance in the task of architectural damage assessment compared to fully convolutional methods.