Karunakar Reddy Mannem , Samuel A. Prieto , Borja García de Soto , Fernando Bacao
{"title":"Weighted adaptive active transfer learning for imbalanced multi-object classification in construction site imagery","authors":"Karunakar Reddy Mannem , Samuel A. Prieto , Borja García de Soto , Fernando Bacao","doi":"10.1016/j.autcon.2025.106297","DOIUrl":null,"url":null,"abstract":"<div><div>Construction site monitoring relies on robust image classification to enhance safety, track progress, and optimize resource management. However, the amount of clutter and the high cost of manual labeling pose significant challenges. This paper presents an approach to multi-object classification in construction sites using Adaptive Active Transfer Learning. The Weighted Active Transfer Learning with Adaptive Sampling (WATLAS) framework is introduced, where Transfer Learning is combined with weighted Active Learning to efficiently classify diverse objects. A pre-trained InceptionV3 architecture integrated with bidirectional long short-term memory (BiLSTM) layers is utilized, and superior performance is achieved through adaptive sampling techniques compared to traditional methods. WATLAS achieves 97 % accuracy on a comprehensive dataset of 9344 construction site images spanning 15 object categories and maintaining 90 % accuracy with only 5 % labeled data. By optimizing performance metrics, the framework demonstrates significant improvements over traditional methods, making it a scalable solution for construction site monitoring.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"176 ","pages":"Article 106297"},"PeriodicalIF":11.5000,"publicationDate":"2025-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Automation in Construction","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0926580525003371","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Construction site monitoring relies on robust image classification to enhance safety, track progress, and optimize resource management. However, the amount of clutter and the high cost of manual labeling pose significant challenges. This paper presents an approach to multi-object classification in construction sites using Adaptive Active Transfer Learning. The Weighted Active Transfer Learning with Adaptive Sampling (WATLAS) framework is introduced, where Transfer Learning is combined with weighted Active Learning to efficiently classify diverse objects. A pre-trained InceptionV3 architecture integrated with bidirectional long short-term memory (BiLSTM) layers is utilized, and superior performance is achieved through adaptive sampling techniques compared to traditional methods. WATLAS achieves 97 % accuracy on a comprehensive dataset of 9344 construction site images spanning 15 object categories and maintaining 90 % accuracy with only 5 % labeled data. By optimizing performance metrics, the framework demonstrates significant improvements over traditional methods, making it a scalable solution for construction site monitoring.
期刊介绍:
Automation in Construction is an international journal that focuses on publishing original research papers related to the use of Information Technologies in various aspects of the construction industry. The journal covers topics such as design, engineering, construction technologies, and the maintenance and management of constructed facilities.
The scope of Automation in Construction is extensive and covers all stages of the construction life cycle. This includes initial planning and design, construction of the facility, operation and maintenance, as well as the eventual dismantling and recycling of buildings and engineering structures.