Xu Xuesong , Xiao Gang , Sun Li , Zhang Xia , Wu Peixi , Zhang Yuanming , Cheng Zhenbo
{"title":"Associative reasoning for engineering drawings using an interactive attention mechanism","authors":"Xu Xuesong , Xiao Gang , Sun Li , Zhang Xia , Wu Peixi , Zhang Yuanming , Cheng Zhenbo","doi":"10.1016/j.autcon.2024.105942","DOIUrl":"10.1016/j.autcon.2024.105942","url":null,"abstract":"<div><div>In infrastructure construction, engineering drawings combine graphic and textual information, with text playing a critical role in retrieving and measuring the similarity of these drawings in practical applications. However, existing research primarily focuses on graphics, neglecting the extraction and semantic representation of text. Existing Optical Character Recognition (OCR)-based methods face challenges in clustering text into coherent semantic modules, frequently dispersing related text across different regions. Therefore, this paper proposes a deep learning framework for the semantic extraction of text from engineering drawings. By integrating textual, positional, and image features, this framework enables semantic extraction and represents engineering drawings as knowledge graphs. An interactive attention-based approach is employed for associative retrieval of engineering drawings via subgraph matching. Evaluation on datasets from a transportation design institute and public sources demonstrates the framework's effectiveness in both semantic extraction and relational reasoning.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"170 ","pages":"Article 105942"},"PeriodicalIF":9.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142918043","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Samira Azhari, Sara Jamshidian, Mohammadjavad Hamidia
{"title":"AI-driven computer vision-based automated repair activity identification for seismically damaged RC columns","authors":"Samira Azhari, Sara Jamshidian, Mohammadjavad Hamidia","doi":"10.1016/j.autcon.2024.105959","DOIUrl":"10.1016/j.autcon.2024.105959","url":null,"abstract":"<div><div>Manual visual inspection is the conventional method for post-earthquake damage assessment, which is unsafe, subjective, and prone to human error. This paper presents an automated rapid and non-contact seismic damage state prediction methodology for reinforced concrete columns using crack image analysis. For surface damage quantification, three features of crack texture complexity including percolation, heterogeneity, and Renyi entropy-based dimensions are measured. Various shallow- and deep-learning-rooted algorithms are trained using a large collected experimental database to develop FEMA P-58-compliant repair activity predictive models. Based on the structural parameters, geometric features, and image-extracted indices, 10 groups of input features are defined. For the overfitting assessment and generalizability evaluation of models, five-fold cross-validations are conducted. Among shallow learning-based algorithms, CatBoost algorithm performs best for the scenarios that rely on vision-derived intricacy indices. Using the deep learning-based multilayer perceptron model as a feedforward artificial neural network, 92 % accuracy is achieved for the testing dataset.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"170 ","pages":"Article 105959"},"PeriodicalIF":9.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142939667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Loss function inversion for improved crack segmentation in steel bridges using a CNN framework","authors":"Andrii Kompanets , Remco Duits , Gautam Pai , Davide Leonetti , H.H. (Bert) Snijder","doi":"10.1016/j.autcon.2024.105896","DOIUrl":"10.1016/j.autcon.2024.105896","url":null,"abstract":"<div><div>Automating bridge visual inspection using deep learning algorithms for crack detection in images is a prominent way to make these inspections more effective. This paper addresses several challenges associated with crack detection: (1) data imbalance, caused by a small crack area as compared to the background, and (2) a high false positive rate, due to a large amount of crack-like features in the background. First, a new benchmark dataset is presented, containing images of cracks in steel bridges along with pixel-wise annotations. Secondly, the importance of incorporating background patches is examined to assess their impact on network performance when applied to high resolution images of cracks in steel bridges. Finally, a loss function is introduced that enables the use of a relatively large number of background patches in neural network training. The proposed approaches yield a significant reduction in false positive rates, thereby improving the overall performance of crack segmentation.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"170 ","pages":"Article 105896"},"PeriodicalIF":9.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143163316","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Ensemble learning framework for forecasting construction costs","authors":"Omar Habib , Mona Abouhamad , AbdElMoniem Bayoumi","doi":"10.1016/j.autcon.2024.105903","DOIUrl":"10.1016/j.autcon.2024.105903","url":null,"abstract":"<div><div>Construction cost forecasting is vital for tendering processes, enabling the evaluation of bidding offers to maximize revenues and avoid losses. In recent years, the automation of this forecasting process has gained attention due to the limitations of traditional approaches that rely on human experts, which can lead to subjective judgments. This paper introduces an ensemble learning decision-support framework that combines regression random forests and gradient-boosting regression trees through regression voting to automate cost estimation for residential and commercial projects. Evaluation of this approach using the dataset from San Francisco’s building inspection department in the United States demonstrated significant performance improvements over support vector regression. This paper highlights the importance of automating construction cost forecasting with artificial intelligence techniques for construction companies and is expected to encourage companies and building inspection departments worldwide to publish more datasets for the application of advanced deep learning models.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"170 ","pages":"Article 105903"},"PeriodicalIF":9.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142816521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hanyun Huang , Mingyang Ma , Suli Bai, Lei Yang, Yanhong Liu
{"title":"Automatic crack defect detection via multiscale feature aggregation and adaptive fusion","authors":"Hanyun Huang , Mingyang Ma , Suli Bai, Lei Yang, Yanhong Liu","doi":"10.1016/j.autcon.2024.105934","DOIUrl":"10.1016/j.autcon.2024.105934","url":null,"abstract":"<div><div>In this paper, a multi-scale feature aggregation and adaptive fusion network, is proposed for automatic and accurate pavement crack defect segmentation. Specifically, faced with the linear characteristic of pavement crack defects, a multiple-dimension attention (MDA) module is proposed to effectively capture long-range correlation from three directions, including space, width and height, and help identify the pavement crack defect boundaries. On this basis, a multi-scale skip connection (MSK) module is proposed, which can effectively utilize the feature information from multiple receptive fields to support accurate feature reconstruction in the decoding stage. Furthermore, a multi-scale attention fusion (MSAF) module is proposed to realize effective multi-scale feature representation and aggregation. Finally, an adaptive weight fusion (AWL) module is proposed to dynamically fuse the output features across different network layers for accurate multi-scale crack defect segmentation. Experiments indicate that proposed network is superior to other mainstream segmentation networks on pixelwise crack defect detection task.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"170 ","pages":"Article 105934"},"PeriodicalIF":9.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142887890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Graph neural networks for classification and error detection in 2D architectural detail drawings","authors":"Jaechang Ko , Donghyuk Lee","doi":"10.1016/j.autcon.2024.105936","DOIUrl":"10.1016/j.autcon.2024.105936","url":null,"abstract":"<div><div>The assessment and classification of architectural sectional drawings is critical in the architecture, engineering, and construction (AEC) field, where the accurate representation of complex structures and the extraction of meaningful patterns are key challenges. This paper established a framework for standardizing different forms of architectural drawings into a consistent graph format, and evaluated different Graph Neural Networks (GNNs) architectures, pooling methods, node features, and masking techniques. This paper demonstrates that GNNs can be practically applied in the design and review process, particularly for categorizing details and detecting errors in architectural drawings. The potential for visual explanations of model decisions using Explainable AI (XAI) is also explored to enhance the reliability and user understanding of AI models in architecture. This paper highlights the potential of GNNs in architectural data analysis and outlines the challenges and future directions for broader application in the AEC field.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"170 ","pages":"Article 105936"},"PeriodicalIF":9.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142887891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Egocentric-video-based construction quality supervision (EgoConQS): Application of automatic key activity queries","authors":"Jingjing Guo , Lu Deng , Pengkun Liu , Tao Sun","doi":"10.1016/j.autcon.2024.105933","DOIUrl":"10.1016/j.autcon.2024.105933","url":null,"abstract":"<div><div>Construction quality supervision is essential for project success and safety. Traditional methods relying on manual inspections and paper records are time-consuming, error-prone, and difficult to verify. In-process construction quality supervision offers a more direct and effective approach. Recent advancements in computer vision and egocentric video analysis present opportunities to enhance these processes. This paper introduces the use of key activity queries on egocentric video data for construction quality supervision. A framework, Egocentric Video-Based Construction Quality Supervision (EgoConQS), is developed using a video self-stitching graph network to identify key activities in egocentric videos. EgoConQS facilitates efficient monitoring and quick review of key activity frames. Empirical evaluation with real-world data demonstrates an average recall of 35.85 % and a mAP score of 6.07 %, highlighting the potential of key activity queries for reliable and convenient quality supervision.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"170 ","pages":"Article 105933"},"PeriodicalIF":9.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142867668","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lu Wan , Ferdinand Rossa , Torsten Welfonder , Ekaterina Petrova , Pieter Pauwels
{"title":"Enabling scalable Model Predictive Control design for building HVAC systems using semantic data modelling","authors":"Lu Wan , Ferdinand Rossa , Torsten Welfonder , Ekaterina Petrova , Pieter Pauwels","doi":"10.1016/j.autcon.2024.105929","DOIUrl":"10.1016/j.autcon.2024.105929","url":null,"abstract":"<div><div>Model Predictive Control (MPC) is a promising optimal control technique to reduce the energy consumption of Heating, Ventilation, and Air Conditioning systems in buildings. However, MPC currently involves significant manual efforts in data preparation, control model design, and software interface design. Better semantic representations of buildings, their systems, and telemetry data could help address these challenges. This paper proposes a standard semantic information model and tooling, tailored to BIM software, to streamline MPC design. The approach is tested in an office building, and the generated semantic graph is validated against a use case, where an MPC controller uses Resistance and Capacitance (RC) models that need to be parameterized. The results show that the automatically identified RC models achieve three-hour-ahead temperature predictions for two different rooms within 0.3 °C accuracy. This indicates that semantic data modelling can enable a scalable MPC configuration workflow and more efficient algorithm development and deployment in the future.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"170 ","pages":"Article 105929"},"PeriodicalIF":9.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142918045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zhuo-Yang Xin , Guan-Qi Zhu , Joseph M. Gattas , Dan Luo
{"title":"Automated large-scale additive manufacturing of structural formwork with rapid fibre-reinforced polymer tape lamination","authors":"Zhuo-Yang Xin , Guan-Qi Zhu , Joseph M. Gattas , Dan Luo","doi":"10.1016/j.autcon.2025.105978","DOIUrl":"10.1016/j.autcon.2025.105978","url":null,"abstract":"<div><div>A fully automated additive lamination manufacturing (ALM) system was developed for producing large-scale fibre-reinforced polymer (FRP) structural formworks. Automation is achieved through the integration of a UV-curable resin matrix with glass fibre tape and a robotic arm end-effector. This paper presents details of the hardware and material development for the UV-based ALM system, as well as performance benchmarks evaluated for two sets of prototypes. The first set compared the geometrical quality and fabrication efficiency of the automated ALM system to the existing semi-automated ALM system, demonstrating improved part quality and faster build speeds. The second set studied the impact of the layer height process parameter on fabrication performance. The design domain for the automatic ALM system was discussed and its fabrication productivity measures were compared with industrial standards and other FRP additive manufacturing approaches. Results highlight the ALM system’s potential for cost-effective, bespoke, and large-scale FRP component construction.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"171 ","pages":"Article 105978"},"PeriodicalIF":9.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143099107","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mi Liu , Jingjing Guo , Lu Deng , Songyue Wang , Huiguang Wang
{"title":"Enhanced vision-based 6-DoF pose estimation for robotic rebar tying","authors":"Mi Liu , Jingjing Guo , Lu Deng , Songyue Wang , Huiguang Wang","doi":"10.1016/j.autcon.2025.105999","DOIUrl":"10.1016/j.autcon.2025.105999","url":null,"abstract":"<div><div>Rebar tying is a labor-intensive and time-consuming task that involves repeatedly securing rebar intersections. While rebar tying robots have been developed to automate this process, most research focuses on tying point localization for horizontal ties, neglecting the 6 degrees of freedom (DoF) tying pose estimation required for reinforcement skeletons with rebar planes in various directions. This paper presents an any-direction robotic rebar tying method (AnyDirTying) for 6-DoF tying pose estimation. First, a deep learning-based keypoint detection algorithm extracts point clouds from rebar intersections. Next, a coarse-to-fine point cloud registration method is developed to improve the accuracy and stability of rebar pose estimation. Finally, a symmetry-aware tying strategy based on the minimum rotation angle is designed to optimize the tying pose and shorten the motion path. The proposed AnyDirTying enables flexible, accurate, and efficient tying pose estimation, expanding the applications of robotic rebar tying and reducing reliance on manual labor.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"171 ","pages":"Article 105999"},"PeriodicalIF":9.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143103348","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}