Chi Tian, Yunfeng Chen, Jiansong Zhang, Yiheng Feng
{"title":"Integrating Domain Knowledge with Deep Learning Model for Automated Worker Activity Classification in mobile work zone","authors":"Chi Tian, Yunfeng Chen, Jiansong Zhang, Yiheng Feng","doi":"10.36680/j.itcon.2024.013","DOIUrl":null,"url":null,"abstract":"Accurate classification of workers’ activity is critical to ensure the safety and productivity of construction projects. Previous studies in this area are mostly focused on building construction environments. Worker activity identification and classification in mobile work zone operations is more challenging, due to more dynamic operating environments (e.g., more movements, weather, and light conditions) than building construction activities. In this study, we propose a deep learning (DL) based classification model to classify workers’ activities in mobile work zones. Sensor locations are optimized for various mobile work zone operations, which helps to collect the training data more effectively and save cost. Furthermore, different from existing models, we innovatively integrate transportation and construction domain knowledge to improve classification accuracy. Three mobile work zone operations (trash pickup, crack sealing, and pothole patching) are investigated in this study. Results show that although using all sensors has the highest performance, utilizing two sensors at optimized locations achieves similar accuracy. After integrating the domain knowledge, the accuracy of the DL model is improved. The DL model trained using two sensors integrated with domain knowledge outperforms the DL model trained using three sensors without integrating domain knowledge.","PeriodicalId":3,"journal":{"name":"ACS Applied Electronic Materials","volume":" 9","pages":""},"PeriodicalIF":4.3000,"publicationDate":"2024-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Electronic Materials","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.36680/j.itcon.2024.013","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Accurate classification of workers’ activity is critical to ensure the safety and productivity of construction projects. Previous studies in this area are mostly focused on building construction environments. Worker activity identification and classification in mobile work zone operations is more challenging, due to more dynamic operating environments (e.g., more movements, weather, and light conditions) than building construction activities. In this study, we propose a deep learning (DL) based classification model to classify workers’ activities in mobile work zones. Sensor locations are optimized for various mobile work zone operations, which helps to collect the training data more effectively and save cost. Furthermore, different from existing models, we innovatively integrate transportation and construction domain knowledge to improve classification accuracy. Three mobile work zone operations (trash pickup, crack sealing, and pothole patching) are investigated in this study. Results show that although using all sensors has the highest performance, utilizing two sensors at optimized locations achieves similar accuracy. After integrating the domain knowledge, the accuracy of the DL model is improved. The DL model trained using two sensors integrated with domain knowledge outperforms the DL model trained using three sensors without integrating domain knowledge.
期刊介绍:
ACS Applied Electronic Materials is an interdisciplinary journal publishing original research covering all aspects of electronic materials. The journal is devoted to reports of new and original experimental and theoretical research of an applied nature that integrate knowledge in the areas of materials science, engineering, optics, physics, and chemistry into important applications of electronic materials. Sample research topics that span the journal's scope are inorganic, organic, ionic and polymeric materials with properties that include conducting, semiconducting, superconducting, insulating, dielectric, magnetic, optoelectronic, piezoelectric, ferroelectric and thermoelectric.
Indexed/Abstracted:
Web of Science SCIE
Scopus
CAS
INSPEC
Portico