{"title":"Self-training method for structural crack detection using image blending-based domain mixing and mutual learning","authors":"Quang Du Nguyen, Huu-Tai Thai, Son Dong Nguyen","doi":"10.1016/j.autcon.2024.105892","DOIUrl":"https://doi.org/10.1016/j.autcon.2024.105892","url":null,"abstract":"Deep learning-based structural crack detection utilizing fully supervised methods requires laborious labeling of training data. Moreover, models trained on one dataset often experience significant performance drops when applied to others due to domain shifts prompted by diverse structures, materials, and environmental conditions. This paper addresses the issues by introducing a robust self-training domain adaptive segmentation (STDASeg) pipeline. STDASeg incorporates an image blending-based domain mixing module to minimize domain discrepancies. Additionally, STDASeg involves a two-stage self-training framework characterized by the mutual learning scheme between Convolutional Neural Networks and Transformers, effectively learning domain invariant features from the two domains. Comprehensive evaluations across three challenging cross-dataset crack detection scenarios highlight the superiority of STDASeg over traditional supervised training approaches and current state-of-the-art methods. These results confirm the stability of STDASeg, thus supporting more efficient infrastructure assessments.","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"34 1","pages":""},"PeriodicalIF":10.3,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142788866","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bridge defect detection using small sample data with deep learning and Hyperspectral imaging","authors":"Xiong Peng, Pengtao Wang, Kun Zhou, Zhipeng Yan, Xingu Zhong, Chao Zhao","doi":"10.1016/j.autcon.2024.105900","DOIUrl":"https://doi.org/10.1016/j.autcon.2024.105900","url":null,"abstract":"The visual sensing method is an effective way to address long-term health monitoring of bridges. However, bridge defect detection based on visible light imaging mainly relies on grayscale and regional edge gradient information, which brings challenges such as limited information dimensions and complex background. This paper introduces a bridge defect detection method that leverages hyperspectral imaging, utilizing the unique integration of spectral and spatial information. Also a convolutional neural network algorithm with dual branches and dense blocks for spectral feature extraction is developed. This framework includes spectral and spatial branches, which independently extract respective features in order to minimize mutual interference. Compared with the support vector machine and traditional deep learning algorithms, the proposed method attains an overall model prediction accuracy(OA) of 98.57 %, an average accuracy (AA) of 98.16 %, and a Kappa coefficient of 0.9814, representing the best classification performance on small sample datasets.","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"20 1","pages":""},"PeriodicalIF":10.3,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142788865","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
James O. Toyin, Anoop Sattineni, Eric M. Wetzel, Ayodele A. Fasoyinu, Jeff Kim
{"title":"Augmented reality in U.S. Construction: Trends and future directions","authors":"James O. Toyin, Anoop Sattineni, Eric M. Wetzel, Ayodele A. Fasoyinu, Jeff Kim","doi":"10.1016/j.autcon.2024.105895","DOIUrl":"https://doi.org/10.1016/j.autcon.2024.105895","url":null,"abstract":"Despite significant research attention on Augmented Reality (AR) in construction, there is a lack of literature on its application trends and future prospects in the U.S. construction industry. The objective of this paper is to investigate the current state of AR in construction, benefits, and drivers and offers actionable suggestions for enhancing AR applications. A systematic critical review and bibliometric mapping of related articles were conducted. Based on defined inclusion and exclusion criteria, 64 eligible articles published between 2006 and 2023 were selected for the final review. The result of this study reveals six key AR application areas, 24 benefits and 23 drivers. Actionable suggestions to advance AR application were also discussed. Additionally, a conceptual model to support effective AR implementation in construction was developed. By synthesizing existing knowledge and identifying future research areas, this study aims to improve the advancement and application of AR technology in the construction industry.","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"10 1","pages":""},"PeriodicalIF":10.3,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142788833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Automated legal consulting in construction procurement using metaheuristically optimized large language models","authors":"Chi-Yun Liu, Jui-Sheng Chou","doi":"10.1016/j.autcon.2024.105891","DOIUrl":"https://doi.org/10.1016/j.autcon.2024.105891","url":null,"abstract":"This paper introduces a hybrid optimization algorithm, Pilgrimage Walk Optimization - Differential Evolution (PWO-DE), inspired by Taiwan's cultural traditions, to fine-tune large language models (LLMs) for government procurement legal consulting. Addressing the unique requirements of Traditional Chinese, this research develops two tailored LLMs, Llama3-TAIDE and Taiwan-LLM, which significantly enhance automated legal advisory systems. Through rigorous comparative evaluations, the PWO-DE algorithm demonstrates superior performance against various well-established single and hybrid metaheuristic algorithms, ensuring effective decision-making and risk management in government procurement. A user-friendly chat interface has also been created, facilitating the practical application of LLMs, increasing their accessibility and impact on legal consulting within the construction and legal fields. This study showcases the integration of cultural insights into algorithmic design, establishing a new benchmark for future advancements in the automation of complex legal consulting tasks.","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"18 1","pages":""},"PeriodicalIF":10.3,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142788871","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Plug-and-play method for segmenting concrete bridge cracks using the segment anything model with a fractal dimension matrix prompt","authors":"Shuai Teng, Airong Liu, Zuxiang Situ, Bingcong Chen, Zhihua Wu, Yixiao Zhang, Jialin Wang","doi":"10.1016/j.autcon.2024.105906","DOIUrl":"https://doi.org/10.1016/j.autcon.2024.105906","url":null,"abstract":"This paper addresses the diverse scenarios of bridge crack segmentation, proposing a method for detecting cracks on land and underwater using the Segment Anything Model (SAM) prompted by a fractal dimension matrix. The proposed method does not require additional training and obtains fractal feature information of cracks through fractal dimension matrix calculation. These feature information serve as prompt information for SAM to establish a plug-and-play crack segmentation method. The method achieves high detection performance, with a mean accuracy, IoU, and F1-Score of 99.6 %, 0.89, and 0.95 for land cracks, and 97.6 %, 0.89, and 0.95 for underwater cracks, respectively. This represents a significant improvement over methods that do not use the fractal dimension matrix for SAM prompts. Additionally, the method requires no additional training, showcasing excellent generalizability and practical potential for real-world applications in diverse environments.","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"38 1","pages":""},"PeriodicalIF":10.3,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142788870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Virtual audit of microscale environmental components and materials using streetscape images with panoptic segmentation and image classification","authors":"Meesung Lee , Hyunsoo Kim , Sungjoo Hwang","doi":"10.1016/j.autcon.2024.105885","DOIUrl":"10.1016/j.autcon.2024.105885","url":null,"abstract":"<div><div>Microscale environmental components, such as street furniture, sidewalks, and green spaces, significantly enhance street quality when properly identified and managed. Traditional in-person audits are time-consuming, so virtual audits using streetscape images and computer vision have been explored as alternatives. However, these often lack a comprehensive range of microscale components and do not consider attributes like materials. This paper proposes an automatic virtual audit method that recognizes microscale component types and materials in streetscape images using panoptic segmentation and material classification of segmented images of detected components. By surveying components affecting pedestrian-perceived street quality to include as many essential components as possible, 33 types of microscale components, as well as materials of sidewalk pavement, architectural elements, and street furniture, were identified with an overall F1 score of 0.946, demonstrating significantly improved performance compared with previous studies. This approach helps enhance street quality by evaluating built environments through an automatic virtual audit.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"170 ","pages":"Article 105885"},"PeriodicalIF":9.6,"publicationDate":"2024-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142759188","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Damage detection in concrete structures with multi-feature backgrounds using the YOLO network family","authors":"Rakesh Raushan , Vaibhav Singhal , Rajib Kumar Jha","doi":"10.1016/j.autcon.2024.105887","DOIUrl":"10.1016/j.autcon.2024.105887","url":null,"abstract":"<div><div>Image processing and Convolution Neural Networks (CNN) are widely used for structural damage assessment. Datasets with damages on similar backgrounds are commonly used in past studies for training and testing of CNN models. These models will often fail to detect damage in images of real infrastructure. A dataset is created which consists of 3750 real images along with its annotations, having diverse features with varying textures, colours, and architectural elements like windows and doors. This study evaluates the performance of You Only Look Once (YOLO) models (v3-v10) on the created dataset, training them in three distinct scenarios: scenario 1 (instances of damage ≤5), scenario 2 (instances of damage >5), and scenario 3 (the complete dataset). The YOLO models show promising results in detecting and locating damages in images with multi-featured backgrounds, wherein the YOLOv4 showed the best precision of 92.2 %, a recall of 86.8 %, and an F1 score of 88.9 %.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"170 ","pages":"Article 105887"},"PeriodicalIF":9.6,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142756904","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Haitao Lin , Hua Zhang , Jianwen Huo , Jialong Li , Huan Zhang , Yonglong Li
{"title":"High-precision 3D reconstruction of underwater concrete using integrated line structured light and stereo vision","authors":"Haitao Lin , Hua Zhang , Jianwen Huo , Jialong Li , Huan Zhang , Yonglong Li","doi":"10.1016/j.autcon.2024.105883","DOIUrl":"10.1016/j.autcon.2024.105883","url":null,"abstract":"<div><div>The absorption and refraction of light by water made high-precision 3D (three-dimensional) reconstruction of underwater concrete a challenging task. This paper proposed a 3D reconstruction method combining line structured light and stereo vision. To improve the reconstruction accuracy, the epipolar constraint was introduced in the light plane calibration process to limit the fringe noise data during calibration matching. A color camera and a monochrome camera were used simultaneously to characterize the real underwater 3D environment. After matching the left and right images, the color information of the color image was retained, and the color information of the point cloud was enhanced. Finally, experiments were conducted in a water tank, and the results indicated that the 3D reconstruction error for underwater concrete was 4.48 %. Moreover, the color enhancement of the point cloud achieved the highest overall scores across the four no-reference underwater image quality assessment metrics.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"169 ","pages":"Article 105883"},"PeriodicalIF":9.6,"publicationDate":"2024-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142745705","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jing Wang , Haizhou Yao , Jinbin Hu , Yafei Ma , Jin Wang
{"title":"Dual-encoder network for pavement concrete crack segmentation with multi-stage supervision","authors":"Jing Wang , Haizhou Yao , Jinbin Hu , Yafei Ma , Jin Wang","doi":"10.1016/j.autcon.2024.105884","DOIUrl":"10.1016/j.autcon.2024.105884","url":null,"abstract":"<div><div>Cracks are a prevalent disease on pavement concrete materials. Timely assessment and repair of concrete materials can significantly extend their service life. However, accurate segmentation has always been difficult due to their random distribution, tortuous geometry, and varying degrees of severity. To address these challenges, a Multi-stage Supervised Dual-encoder network for Crack segmentation on pavement concrete (MSDCrack) was proposed based on an encoder–decoder architecture. In this network, attention collapse is mitigated through the addition of self-attention pooling. Furthermore, a feature fusion module was designed to address differences in encoding characteristics across branches. Additionally, a multi-stage supervision strategy was implemented to enhance the network’s predictive performance. Comparative experiments demonstrated that MSDCrack achieved the highest Dice coefficient, F1-score, and IoU on multiple datasets, with F1-score and IoU surpassing other state-of-the-art segmentation networks by over 3.1% and 2.89%, respectively, in generalization performance.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"169 ","pages":"Article 105884"},"PeriodicalIF":9.6,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142746237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yin Junjia Ph.D., Aidi Hizami Alias Ph.D., Nuzul Azam Haron Ph.D., Nabilah Abu Bakar Ph.D.
{"title":"Deep learning for safety risk management in modular construction: Status, strengths, challenges, and future directions","authors":"Yin Junjia Ph.D., Aidi Hizami Alias Ph.D., Nuzul Azam Haron Ph.D., Nabilah Abu Bakar Ph.D.","doi":"10.1016/j.autcon.2024.105894","DOIUrl":"10.1016/j.autcon.2024.105894","url":null,"abstract":"<div><div>Occupational health risks such as falls from height, electrocution, object strikes, mechanical injuries, and collapses have plagued the construction industry. Deep learning algorithms are exploding due to their outstanding analytical capabilities and are believed to improve safety management significantly. Therefore, this paper systematically reviewed the literature on DL algorithms from 2015 to 2024 in modular construction. It found that the six most popular DL algorithms in this area are “Convolutional Neural Network (CNN),” “Recurrent Neural Network (RNN),” “Generative Adversarial Network (GAN),” “Auto-Encoder (AE),” “Deep Belief Network (DBN)” and “Transformer.” However, in addition to each algorithm's limitations, problems like data constraints, talent gaps, and a lack of guidance frameworks also exist. To address these issues, three strategies are proposed. They are “establishing a multi-modal data sharing platform,” “proposing a paradigm framework for the application of DL algorithms,” and “constructing a compound construction talent training mechanism,” which provide researchers with future references.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"169 ","pages":"Article 105894"},"PeriodicalIF":9.6,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142746236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}