Implementation of explanatory texts output for bridge damage in a bridge inspection web system

IF 4 2区工程技术 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS

Advances in Engineering Software Pub Date : 2024-06-21 DOI:10.1016/j.advengsoft.2024.103706

Pang-jo Chun , Honghu Chu , Kota Shitara , Tatsuro Yamane , Yu Maemura

{"title":"Implementation of explanatory texts output for bridge damage in a bridge inspection web system","authors":"Pang-jo Chun , Honghu Chu , Kota Shitara , Tatsuro Yamane , Yu Maemura","doi":"10.1016/j.advengsoft.2024.103706","DOIUrl":null,"url":null,"abstract":"<div><p>Bridge photographs contain significant technical information, such as damaged structural parts and types of damage, yet interpreting these details is not always straightforward. Despite the advancements in image analysis for bridge inspection, there remains a significant gap in converting these images into comprehensible explanatory texts that can be readily used by less experienced engineers and administrative staff for effective maintenance decision-making. In this study, we developed a model that generates explanatory texts from bridge images based on a deep learning model, and we also developed a web system that can be utilized during bridge inspections. The proposed method enables the provision of user-friendly, text-based explanations of bridge damage within images, allowing relatively inexperienced engineers and administrative staff without extensive technical expertise to understand the representation of bridge damage in text form. Additionally, we have developed a system that continually trains and improves its performance by accumulating data as users interact with it. This paper describes the image captioning technique for generating explanatory texts and the structure of the web system.</p></div>","PeriodicalId":50866,"journal":{"name":"Advances in Engineering Software","volume":"195 ","pages":"Article 103706"},"PeriodicalIF":4.0000,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0965997824001133/pdfft?md5=939648364f624a38c53552eb9cd46e6f&pid=1-s2.0-S0965997824001133-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advances in Engineering Software","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0965997824001133","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}

引用次数: 0

Abstract

Bridge photographs contain significant technical information, such as damaged structural parts and types of damage, yet interpreting these details is not always straightforward. Despite the advancements in image analysis for bridge inspection, there remains a significant gap in converting these images into comprehensible explanatory texts that can be readily used by less experienced engineers and administrative staff for effective maintenance decision-making. In this study, we developed a model that generates explanatory texts from bridge images based on a deep learning model, and we also developed a web system that can be utilized during bridge inspections. The proposed method enables the provision of user-friendly, text-based explanations of bridge damage within images, allowing relatively inexperienced engineers and administrative staff without extensive technical expertise to understand the representation of bridge damage in text form. Additionally, we have developed a system that continually trains and improves its performance by accumulating data as users interact with it. This paper describes the image captioning technique for generating explanatory texts and the structure of the web system.

查看原文本刊更多论文

在桥梁检测网络系统中实现桥梁损坏说明文本输出

桥梁照片包含重要的技术信息，如损坏的结构部分和损坏类型，但解释这些细节并不总是那么简单。尽管用于桥梁检测的图像分析技术不断进步，但在将这些图像转换成可理解的解释性文本方面仍存在巨大差距，而这些文本可随时供经验不足的工程师和行政人员使用，以做出有效的维护决策。在本研究中，我们开发了一种基于深度学习模型从桥梁图像生成解释性文本的模型，还开发了一个可在桥梁检测过程中使用的网络系统。所提出的方法能够在图像中提供用户友好的、基于文本的桥梁损坏说明，使相对缺乏经验的工程师和没有丰富专业技术知识的行政人员能够理解以文本形式呈现的桥梁损坏情况。此外，我们还开发了一个系统，通过积累用户与系统交互时的数据，不断训练和提高系统性能。本文介绍了生成说明性文本的图像标题技术和网络系统的结构。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Advances in Engineering Software 工程技术-计算机：跨学科应用

CiteScore

7.70

自引率

4.20%

发文量

169

审稿时长

37 days

期刊介绍： The objective of this journal is to communicate recent and projected advances in computer-based engineering techniques. The fields covered include mechanical, aerospace, civil and environmental engineering, with an emphasis on research and development leading to practical problem-solving. The scope of the journal includes: • Innovative computational strategies and numerical algorithms for large-scale engineering problems • Analysis and simulation techniques and systems • Model and mesh generation • Control of the accuracy, stability and efficiency of computational process • Exploitation of new computing environments (eg distributed hetergeneous and collaborative computing) • Advanced visualization techniques, virtual environments and prototyping • Applications of AI, knowledge-based systems, computational intelligence, including fuzzy logic, neural networks and evolutionary computations • Application of object-oriented technology to engineering problems • Intelligent human computer interfaces • Design automation, multidisciplinary design and optimization • CAD, CAE and integrated process and product development systems • Quality and reliability.