Jinze Luo , Qianxun Yang , Yumeng Sun , Lunpeng Li , Wenyuan Cai , Yuchuan Du , Chenglong Liu
{"title":"智能人行道状况监测的四足机器人框架","authors":"Jinze Luo , Qianxun Yang , Yumeng Sun , Lunpeng Li , Wenyuan Cai , Yuchuan Du , Chenglong Liu","doi":"10.1016/j.autcon.2025.106600","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate detection of sidewalk conditions is critical for enhancing the safety and efficiency of urban non-motorized transportation systems. Existing manual inspection methods, while effective for limited scenarios, fall short in terms of efficiency, coverage, and the detection of concealed defects. This paper introduces a sidewalk inspection framework that leverages a quadruped robot equipped with visual and vibration sensors to comprehensively address complex pavement scenes and hidden loosened bricks. For visual inspection, an improved YOLO11 model with a dynamic attention-weighted sampling mechanism enhances detection accuracy for minority-class defects, achieving a mAP of 0.883. For hidden defect identification, a Physics-Informed Neural Network with a Long Short-Term Memory network (PINN-LSTM) is proposed to fuse physical constraints with temporal patterns, achieving an overall accuracy of 0.9430. The value of the physics-informed approach is further substantiated by its performance in cross-domain generalization, few-shot adaptation, and robustness tests, confirming its potential for practical applications.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"181 ","pages":"Article 106600"},"PeriodicalIF":11.5000,"publicationDate":"2025-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Quadruped robot-enabled framework for intelligent sidewalk condition monitoring\",\"authors\":\"Jinze Luo , Qianxun Yang , Yumeng Sun , Lunpeng Li , Wenyuan Cai , Yuchuan Du , Chenglong Liu\",\"doi\":\"10.1016/j.autcon.2025.106600\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Accurate detection of sidewalk conditions is critical for enhancing the safety and efficiency of urban non-motorized transportation systems. Existing manual inspection methods, while effective for limited scenarios, fall short in terms of efficiency, coverage, and the detection of concealed defects. This paper introduces a sidewalk inspection framework that leverages a quadruped robot equipped with visual and vibration sensors to comprehensively address complex pavement scenes and hidden loosened bricks. For visual inspection, an improved YOLO11 model with a dynamic attention-weighted sampling mechanism enhances detection accuracy for minority-class defects, achieving a mAP of 0.883. For hidden defect identification, a Physics-Informed Neural Network with a Long Short-Term Memory network (PINN-LSTM) is proposed to fuse physical constraints with temporal patterns, achieving an overall accuracy of 0.9430. The value of the physics-informed approach is further substantiated by its performance in cross-domain generalization, few-shot adaptation, and robustness tests, confirming its potential for practical applications.</div></div>\",\"PeriodicalId\":8660,\"journal\":{\"name\":\"Automation in Construction\",\"volume\":\"181 \",\"pages\":\"Article 106600\"},\"PeriodicalIF\":11.5000,\"publicationDate\":\"2025-10-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Automation in Construction\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0926580525006405\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CONSTRUCTION & BUILDING TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Automation in Construction","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0926580525006405","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
Quadruped robot-enabled framework for intelligent sidewalk condition monitoring
Accurate detection of sidewalk conditions is critical for enhancing the safety and efficiency of urban non-motorized transportation systems. Existing manual inspection methods, while effective for limited scenarios, fall short in terms of efficiency, coverage, and the detection of concealed defects. This paper introduces a sidewalk inspection framework that leverages a quadruped robot equipped with visual and vibration sensors to comprehensively address complex pavement scenes and hidden loosened bricks. For visual inspection, an improved YOLO11 model with a dynamic attention-weighted sampling mechanism enhances detection accuracy for minority-class defects, achieving a mAP of 0.883. For hidden defect identification, a Physics-Informed Neural Network with a Long Short-Term Memory network (PINN-LSTM) is proposed to fuse physical constraints with temporal patterns, achieving an overall accuracy of 0.9430. The value of the physics-informed approach is further substantiated by its performance in cross-domain generalization, few-shot adaptation, and robustness tests, confirming its potential for practical applications.
期刊介绍:
Automation in Construction is an international journal that focuses on publishing original research papers related to the use of Information Technologies in various aspects of the construction industry. The journal covers topics such as design, engineering, construction technologies, and the maintenance and management of constructed facilities.
The scope of Automation in Construction is extensive and covers all stages of the construction life cycle. This includes initial planning and design, construction of the facility, operation and maintenance, as well as the eventual dismantling and recycling of buildings and engineering structures.